-- Logs begin at Mon 2022-05-16 14:11:28 UTC, end at Mon 2022-05-16 15:34:53 UTC. -- May 16 14:54:19.191028 dv-cinder-795785-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 14:54:19.202738 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 14:54:19 2022] *** May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: nodename: dv-cinder-795785-10-iscsi May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: machine: x86_64 May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: clock source: unix May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: pcre jit disabled May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: detected number of CPU cores: 4 May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: current working directory: / May 16 14:54:19.204747 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: detected binary path: /usr/bin/uwsgi-core May 16 14:54:19.205386 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: your processes number limit is 47680 May 16 14:54:19.205386 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: your memory page size is 4096 bytes May 16 14:54:19.205386 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: detected max file descriptor number: 2048 May 16 14:54:19.205386 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: lock engine: pthread robust mutexes May 16 14:54:19.205386 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: thunder lock: enabled May 16 14:54:19.205386 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 14:54:19.205386 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 14:54:19.252502 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: Python main interpreter initialized at 0x5618d37049c0 May 16 14:54:19.252502 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: python threads support enabled May 16 14:54:19.252502 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: your server socket listen backlog is limited to 100 connections May 16 14:54:19.252502 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: your mercy for graceful operations on workers is 90 seconds May 16 14:54:19.252833 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: mapped 403077 bytes (393 KB) for 2 cores May 16 14:54:19.252906 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: *** Operational MODE: preforking *** May 16 14:54:19.253179 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: *** uWSGI is running in multiple interpreter mode *** May 16 14:54:19.253179 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: spawned uWSGI master process (pid: 80167) May 16 14:54:19.253373 dv-cinder-795785-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 14:54:19.254999 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: spawned uWSGI worker 1 (pid: 80178, cores: 1) May 16 14:54:19.254999 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: spawned uWSGI worker 2 (pid: 80179, cores: 1) May 16 14:54:19.254999 dv-cinder-795785-10-iscsi devstack@keystone.service[80167]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 14:54:24.997240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 14:54:24.997240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: from cryptography.utils import int_from_bytes May 16 14:54:24.998129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 14:54:24.998129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: from cryptography.utils import int_from_bytes May 16 14:54:24.998634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 14:54:24.998634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: from cryptography.utils import int_from_bytes May 16 14:54:24.999422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 14:54:24.999422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: from cryptography.utils import int_from_bytes May 16 14:54:25.047254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 14:54:25.047448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 14:54:25.047636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] command line args: [] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 14:54:25.047902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 14:54:25.047992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 14:54:25.048079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ================================================================================ {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 14:54:25.048159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 14:54:25.048277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] command line args: [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 14:54:25.048363 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] admin_token = **** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.048547 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] config_dir = [] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.048632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 14:54:25.048716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ================================================================================ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 14:54:25.048793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.048898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] config_source = [] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.048987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] admin_token = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.049065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] debug = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.049194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] config_dir = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.049283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.049490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.049560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] config_source = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.049623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.049761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] debug = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.049851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.049918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.050005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.050167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.050280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.050364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.050498 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] list_limit = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.050578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.050686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] log_config_append = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.050809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.050888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] log_dir = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] log_file = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_config_append = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_dir = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_file = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.051886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052566 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.052969 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.053083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.053196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.053313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.053427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.053559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.053708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.053790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.053912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.054020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.054135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.054280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.054411 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.054516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.054600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.054765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.055014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.055095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.055219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] publish_errors = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.055305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.055408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.055637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.055763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.055855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.055936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] publish_errors = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.056025 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.056173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.056286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.056420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.056589 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] standard_threads = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.056664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.056729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.056821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.056986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] use_journal = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057356 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] standard_threads = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] use_json = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] use_stderr = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] use_syslog = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057795 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.057975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.058095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_journal = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.058209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.058294 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_json = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.058439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_stderr = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.058516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.058616 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_syslog = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.058706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.058849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 14:54:25.058927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.059106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.059189 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.059347 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.059435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.059607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.059689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.059842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.059919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.060087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.060172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.060326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.060402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.060577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.060677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.060815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.060974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.061050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.061151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.061298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.061381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.061546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.061636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.061782 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.061860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.062029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.062125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.062297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.062387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.062549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.062632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.062799 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.062882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.063031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.063115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.063283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.063366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.063536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.063618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.063782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.063876 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.064017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.064100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.064242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.064325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.064471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.064557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.064704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.064814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.064940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.065036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.065185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.065272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.065427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.065536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.065657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.065761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.065887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.065999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.066194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.066306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.066402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.066497 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.066615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.066732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.066846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.066924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.067077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.067157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.067836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.067957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.068073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.068194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.068302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.068409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.068592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.068677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.068841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.068922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.069082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.069166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.069317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.069399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.069550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.069635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.069784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.069870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.070017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.070133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.070289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.070368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.070524 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.070602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.070759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.070847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.070999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.071075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.071226 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.071304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.071463 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.071551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.071696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.071813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.071930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.072009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.072162 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.072260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.072394 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.072476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.072621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.072699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.072864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.072948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.073094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.073178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.073328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.073406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.073557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.073647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.073795 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.073869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.074031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.074178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.074277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.074379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.074505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.074617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.074723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.074820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.074993 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.075109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.075216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.075312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.075455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.075559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.075693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.075798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.075965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.076072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.076206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.076317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.076483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.076607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.076718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.076827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.076957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.077073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.077187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.077297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.077424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.077538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.077664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.077769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.077902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.078013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.078162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.078301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.078423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.078538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.078653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.078767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.078886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.079009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.079124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.079238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.079351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.079465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.080938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.081011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.081081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.081191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.081310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.081432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.081525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.081670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.081770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.081907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.082008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.082165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.082281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.082408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.082519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.082644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.082771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.083544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.083644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.083807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.083887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.084037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] auth.external = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.084114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.084268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.084355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.084537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.084614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.084778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.084856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.085009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] auth.password = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.085088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.085503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] auth.token = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.085598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.external = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.085745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.085836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.085980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.086141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.086232 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.086307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.086465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.086546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.password = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.086711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.086791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.token = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.086957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.087039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.087186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.087265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.087420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] credential.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.087499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.087644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.087720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.087891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.087971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.088131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.088209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.088367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.088452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.088607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.088687 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.088838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.088915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.089094 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.089174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.089341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.089419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.089575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.089654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.089820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.089899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.090074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.090156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.090349 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.090429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.090606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.090686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.090845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.090923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.091096 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.091175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.091332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] federation.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.091412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.091568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.091648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.091809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.091888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.092053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.092133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.092282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.092362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.092525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.092604 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.092758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.092838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.093007 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.093087 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.093242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.093321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.093480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.093567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.093713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.093797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.093953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.094031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.094220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.094301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.094464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.094542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.094705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.094783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.094941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.095022 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.095175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.095254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.095412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.095499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.095640 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.095718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.095876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.095954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.096121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.096208 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.096358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.096437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.096586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.096664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.096814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.096901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.097042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.097121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.097285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.097363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.097532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.097619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.097764 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.097842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.097999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.098156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.098328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.098418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.098624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.098705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.098878 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.098956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.099129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.099219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.099361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.099439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.099598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.099678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.099829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.099917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.100069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.100176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.100309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.100445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.100530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.100614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.100780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.100859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.101011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.101088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.101249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.101336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.101491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.101569 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.101724 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.101812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.101967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.102071 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.102225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.102304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.102454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.102532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.102691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.102786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.102920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.102999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.103155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.103242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.103389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.103477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.103626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.103705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.103861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.103940 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.104091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.104177 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.104333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.104412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.104574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.104652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.104801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.104887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.105031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.105109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.105272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.105356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.105515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.105600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.105749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.105828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.105979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.106082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.106234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.106324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.106464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.106542 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.106701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.106780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.106944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.107031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.107173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.107250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.107408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.107492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.107641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.107721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.107881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.107959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.108110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.108187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.108339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.108419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.108571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.108650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.108804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.108882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.109044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.109124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.109272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.109352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.109505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.109582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.109744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.109825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.109983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.110079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.110247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.110326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.110478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.110555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.110702 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.110780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.110949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.111027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.111183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.111262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.111418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.111496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.111652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.111730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.111881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.111966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.112120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.112198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.112360 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.112437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.112592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.112671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.112829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.112906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.113058 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.113135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.113301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.113381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.113536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.113615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.113769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.113847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.114002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.114136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.114293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.114372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.114532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.114610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.114762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.114843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.114997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.115075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.115236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.115315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] resource.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.115480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.115560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.115721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.115799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.115953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.116037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.116190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.116275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.116435 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.116513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.116665 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.116743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.116907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.116990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.117141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.117219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.117380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.117458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.117613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] role.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.117693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.117856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.117933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] role.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.118102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.118193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.118354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.118434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.118595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.118673 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.118834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] role.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.118913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.119081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.119160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] role.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.119312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.119389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.119554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.119632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.119798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.119878 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.120042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.120121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.120272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.120359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.120517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.120596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.120759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.120838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.121002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.121089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.121244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.121324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.121476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.121654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.121733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.121892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.121972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.122162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.122242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.122413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.122492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.122660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.122888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.122967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.123127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.123205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.123378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.123465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.123627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.123707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.123864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.123943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.124093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.124181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.124323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.124402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.124553 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.124632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.124802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.124891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.125053 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.125131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.125290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.125369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.125520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.125599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.125752 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.125830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.125978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.126106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.126235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] token.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.126317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.126471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.126550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.126714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.126793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.126948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.127029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.127187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.127265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.127427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.127506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.127657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.127736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.127899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.127979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.128135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.128212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.128375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.128453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.128610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.128688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.128854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.128931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.129091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.129170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.129338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.129442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.129579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.129669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.130345 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.130437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.130588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.130675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.130832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.130919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.131081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.131170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.connection = **** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.131332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.131429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.131567 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.131653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.131799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.131885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.132037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.132115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.132257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.132344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.132490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.132587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.132722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.132818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.132956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.133113 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.133188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.133260 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.133418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.133514 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.133658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.133748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.133890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.133978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.134159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.134259 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.134393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.134480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.134635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.134722 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.134863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.134963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.135100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.135187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.135331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.135419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.135491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80179) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 14:54:25.135571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.135821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.136054 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.136299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.136538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 14:54:25.136708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 14:54:25.166661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.166860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.166970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.167092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.167176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.167319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.175683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.175986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.203944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.204170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.204668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.204901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.256889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.257812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.307489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.307717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.309066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.309304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.372648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.372870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.373089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.373313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.373405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.373508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.373590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.373719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.373811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.373954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.374206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.374427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.396932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.397148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.397238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.397383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.397467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.397594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.397675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.397805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.397889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.398036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.398140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.398270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.398365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.398519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.409469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.409981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.429231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.429385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.429471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.429547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.429658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.429765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.429853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.429930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.430082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.430168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.430293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.430376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.430502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80179) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.430586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 14:54:25.447600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.447807 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 14:54:25.448141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.448238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.448384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 14:54:25.448461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 14:54:25.448637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.448774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.448891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.448982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 14:54:25.449143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.449226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.449392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.449472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.449760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.450021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.461408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.461677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.461898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.461982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.462203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.462290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.462472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.462752 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.470441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.470899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.474262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.474536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.474808 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.474890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.475108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.475190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.475389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.475472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.475694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.475775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.475957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.476040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.476225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.476307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.476490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.476579 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.476788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.476868 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.477055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.477136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.477333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.477608 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.503487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.504899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.505128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.505401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.506575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.506857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.510769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.511001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.511274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.512211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.512491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.512770 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.518568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.518841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.520166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.520988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.523970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.524254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.524534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.524810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.525077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.525342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.525605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.525683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.525869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.525957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.526198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.526483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.526759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.527032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.527303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.527569 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.544895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.545165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.546851 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.547133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.549745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.552194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.553867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.554180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.555842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.556140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.559103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.561112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.562653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.564705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.566456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.566749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.567027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.567848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.568123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.568393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.569056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.569354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.569638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.569923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.570223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.570503 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.587523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.587888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.588150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.588406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.589765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.590168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.590441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.590703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.596241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.597957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.598257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.598675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.600414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.600691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.601293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.601564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.601840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.602143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.602422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.603768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.604049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.604343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.604626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.604900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.616276 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.616547 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.616824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.617107 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.617383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.617666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.617935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.618886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.619164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.619444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.619745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.620027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.620308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.620582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.636339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.639248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.639597 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.642578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.642927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.644494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.645931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.646159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.646443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.646757 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.647563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.649184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.649459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.649755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.654114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.655722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.657213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.658853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.658938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.659203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.659478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.659746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.662149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.662440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.662725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.663000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.669063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.669355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.669630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.672198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.672493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.672773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.678160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80179) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.678431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.678702 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.678968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.679231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.679512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.679781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.680052 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.680314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.680574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.680835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.681103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.681311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 14:54:25.681392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.681589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.681670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80179) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.681872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.682180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.682460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.682748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.683025 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.683302 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.683574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.683843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.684113 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.684389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.684660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.684919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 14:54:25.720660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618d37049c0 pid: 80179 (default app) May 16 14:54:25.724550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e1e3c-48eb-48c1-b1f6-5d62ce574c46 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:25.724838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e1e3c-48eb-48c1-b1f6-5d62ce574c46 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:25.724919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618d37049c0 pid: 80178 (default app) May 16 14:54:25.725119 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e1e3c-48eb-48c1-b1f6-5d62ce574c46 None None] PATH_INFO: `/v3` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:25.729354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Mon May 16 14:54:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:34.698854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96214e3d-cd13-42d3-a27e-bf64f5359d22 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:34.699392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96214e3d-cd13-42d3-a27e-bf64f5359d22 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:34.699392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96214e3d-cd13-42d3-a27e-bf64f5359d22 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:34.703695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:34.709130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:34.709492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:34.709681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:34.740964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG oslo_db.sqlalchemy.engines [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80179) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 14:54:34.918025 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG passlib.handlers.bcrypt [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80179) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 14:54:34.918459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG passlib.handlers.bcrypt [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80179) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 14:54:34.973559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:34.975137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:35.093388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 16 14:54:35.278780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96214e3d-cd13-42d3-a27e-bf64f5359d22 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:35.312210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG oslo_db.sqlalchemy.engines [None req-96214e3d-cd13-42d3-a27e-bf64f5359d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 14:54:35.438912 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96214e3d-cd13-42d3-a27e-bf64f5359d22 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:35.443742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507460c4-6498-4439-b995-10826c135d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:35.444394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507460c4-6498-4439-b995-10826c135d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:35.444681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507460c4-6498-4439-b995-10826c135d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:35.444959 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507460c4-6498-4439-b995-10826c135d04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:35.452880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507460c4-6498-4439-b995-10826c135d04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:35.504959 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING keystone.common.rbac_enforcer.enforcer [None req-507460c4-6498-4439-b995-10826c135d04 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 14:54:35.505293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507460c4-6498-4439-b995-10826c135d04 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:35.514879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Mon May 16 14:54:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 14:54:35.521448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:35.535416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6938411-6748-4fe9-b481-f444cf45638d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:35.539899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d03f62-ece2-4e92-a803-483f7049978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:35.540996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d03f62-ece2-4e92-a803-483f7049978c admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:35.541281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d03f62-ece2-4e92-a803-483f7049978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:35.541565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d03f62-ece2-4e92-a803-483f7049978c admin admin] PATH_INFO: `/v3/projects/205b1267d8204d608304e6a78a0e361f` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:35.543094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d03f62-ece2-4e92-a803-483f7049978c admin admin] RBAC: Authorizing `identity:get_project(project_id=205b1267d8204d608304e6a78a0e361f)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:35.593549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e0d03f62-ece2-4e92-a803-483f7049978c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 14:54:35.593890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d03f62-ece2-4e92-a803-483f7049978c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:35.598532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Mon May 16 14:54:35 2022] GET /identity/v3/projects/205b1267d8204d608304e6a78a0e361f => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:37.744633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd433813-ed8d-4655-b47e-496ecea8916e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:37.745215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd433813-ed8d-4655-b47e-496ecea8916e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:37.745215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd433813-ed8d-4655-b47e-496ecea8916e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:37.749343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:37.754771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5766e-a68b-442a-838f-a5398490f111 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:37.755128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5766e-a68b-442a-838f-a5398490f111 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:37.755320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5766e-a68b-442a-838f-a5398490f111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:37.774727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-06b5766e-a68b-442a-838f-a5398490f111 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:37.776224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-06b5766e-a68b-442a-838f-a5398490f111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:37.783919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 14:54:37.806335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd433813-ed8d-4655-b47e-496ecea8916e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:37.818120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd433813-ed8d-4655-b47e-496ecea8916e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:37.822383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906f632-8924-403d-9532-7b15bef940ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:37.823008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f632-8924-403d-9532-7b15bef940ee admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:37.823293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f632-8924-403d-9532-7b15bef940ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:37.823572 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f632-8924-403d-9532-7b15bef940ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:37.831076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906f632-8924-403d-9532-7b15bef940ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:37.832849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906f632-8924-403d-9532-7b15bef940ee admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:37.841644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Mon May 16 14:54:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 14:54:37.846731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5766e-a68b-442a-838f-a5398490f111 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:37.855862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5766e-a68b-442a-838f-a5398490f111 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:37.860175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca876c-04a0-4bd3-964b-69b0177650fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:37.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca876c-04a0-4bd3-964b-69b0177650fb admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:37.861286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca876c-04a0-4bd3-964b-69b0177650fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:37.861555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca876c-04a0-4bd3-964b-69b0177650fb admin admin] PATH_INFO: `/v3/users/efb24a53849544a0bc7346ef2b1d8c20` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:37.862947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca876c-04a0-4bd3-964b-69b0177650fb admin admin] RBAC: Authorizing `identity:get_user(user_id=efb24a53849544a0bc7346ef2b1d8c20)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:37.865362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca876c-04a0-4bd3-964b-69b0177650fb admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:37.866983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Mon May 16 14:54:37 2022] GET /identity/v3/users/efb24a53849544a0bc7346ef2b1d8c20 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:40.121509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe43e6-bbb3-4e16-99ff-b126c944bea3 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.122020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe43e6-bbb3-4e16-99ff-b126c944bea3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.122128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe43e6-bbb3-4e16-99ff-b126c944bea3 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.123507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:54:40.128644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2b1d8-799d-4304-ab9a-54cd0584907c None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.129036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2b1d8-799d-4304-ab9a-54cd0584907c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.129213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2b1d8-799d-4304-ab9a-54cd0584907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.155640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b75e2-5cdd-4e8b-abd1-d696a2c228e0 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.155921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b75e2-5cdd-4e8b-abd1-d696a2c228e0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.156192 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b75e2-5cdd-4e8b-abd1-d696a2c228e0 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.157785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:54:40.164119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338211c8-9a02-4f71-be3a-c950d3353991 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.164407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338211c8-9a02-4f71-be3a-c950d3353991 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.164688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338211c8-9a02-4f71-be3a-c950d3353991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.205894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG passlib.handlers.bcrypt [None req-338211c8-9a02-4f71-be3a-c950d3353991 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80178) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 14:54:40.206343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG passlib.handlers.bcrypt [None req-338211c8-9a02-4f71-be3a-c950d3353991 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80178) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 14:54:40.253515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-48e2b1d8-799d-4304-ab9a-54cd0584907c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:40.253781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-338211c8-9a02-4f71-be3a-c950d3353991 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:40.254799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-48e2b1d8-799d-4304-ab9a-54cd0584907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:40.255427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-338211c8-9a02-4f71-be3a-c950d3353991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:40.330932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:40.352629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:54:40.355263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2b1d8-799d-4304-ab9a-54cd0584907c None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:40.374385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338211c8-9a02-4f71-be3a-c950d3353991 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:40.449626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2b1d8-799d-4304-ab9a-54cd0584907c None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:40.468023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338211c8-9a02-4f71-be3a-c950d3353991 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:40.481124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7008-927b-472f-b36d-3517e195d58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:40.481914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7008-927b-472f-b36d-3517e195d58c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.482234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7008-927b-472f-b36d-3517e195d58c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.482510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e7008-927b-472f-b36d-3517e195d58c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.493597 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e7008-927b-472f-b36d-3517e195d58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:54:40.499955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91b73-8d4d-42c5-aebf-012da4ed971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:40.500840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91b73-8d4d-42c5-aebf-012da4ed971e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.501127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91b73-8d4d-42c5-aebf-012da4ed971e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.501404 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91b73-8d4d-42c5-aebf-012da4ed971e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-179e7008-927b-472f-b36d-3517e195d58c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:54:40.505219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:54:40.506030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:54:40.506888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:54:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:54:40.512324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7008-927b-472f-b36d-3517e195d58c None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:40.564788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91b73-8d4d-42c5-aebf-012da4ed971e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:40.566353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91b73-8d4d-42c5-aebf-012da4ed971e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:40.604615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e7008-927b-472f-b36d-3517e195d58c None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:40.635545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e805-5ca8-4351-bed2-db231b49c44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:40.636206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e805-5ca8-4351-bed2-db231b49c44c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.636488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e805-5ca8-4351-bed2-db231b49c44c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.636760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65e805-5ca8-4351-bed2-db231b49c44c None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.637508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65e805-5ca8-4351-bed2-db231b49c44c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:40.637816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65e805-5ca8-4351-bed2-db231b49c44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:40.639237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65e805-5ca8-4351-bed2-db231b49c44c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:40.651743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:54:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:54:40.657994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e805-5ca8-4351-bed2-db231b49c44c None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:40.658866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:54:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 14:54:40.664507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91b73-8d4d-42c5-aebf-012da4ed971e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:40.749420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65e805-5ca8-4351-bed2-db231b49c44c None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:40.757053 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91b73-8d4d-42c5-aebf-012da4ed971e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:40.782847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72b17c-0179-4d22-a7b8-db55cf3c10d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:40.783708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b17c-0179-4d22-a7b8-db55cf3c10d2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.783985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b17c-0179-4d22-a7b8-db55cf3c10d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.784253 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b17c-0179-4d22-a7b8-db55cf3c10d2 None admin] PATH_INFO: `/v3/users/efb24a53849544a0bc7346ef2b1d8c20` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.785455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72b17c-0179-4d22-a7b8-db55cf3c10d2 None admin] RBAC: Authorizing `identity:get_user(user_id=efb24a53849544a0bc7346ef2b1d8c20)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:40.786942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72b17c-0179-4d22-a7b8-db55cf3c10d2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:40.788442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b3fc8-77e9-4cec-adfc-95b9929bffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:40.788551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:54:40 2022] GET /identity/v3/users/efb24a53849544a0bc7346ef2b1d8c20 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:54:40.789316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b3fc8-77e9-4cec-adfc-95b9929bffda None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.789665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b3fc8-77e9-4cec-adfc-95b9929bffda None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.789949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b3fc8-77e9-4cec-adfc-95b9929bffda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.793793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72b17c-0179-4d22-a7b8-db55cf3c10d2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:40.891978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72b17c-0179-4d22-a7b8-db55cf3c10d2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:40.914818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b3fc8-77e9-4cec-adfc-95b9929bffda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:40.916292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b3fc8-77e9-4cec-adfc-95b9929bffda None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:40.924475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3fbcc-1006-466c-80b1-a0752856b0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:40.925267 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3fbcc-1006-466c-80b1-a0752856b0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:40.925545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3fbcc-1006-466c-80b1-a0752856b0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:40.925843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3fbcc-1006-466c-80b1-a0752856b0e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:40.927051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3fbcc-1006-466c-80b1-a0752856b0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:40.928464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3fbcc-1006-466c-80b1-a0752856b0e2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:40.930073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:54:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:54:40.935649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3fbcc-1006-466c-80b1-a0752856b0e2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c58b3fc8-77e9-4cec-adfc-95b9929bffda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:54:40.936860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:54:40.937788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:54:40.938938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:54:40.938938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:54:40.938938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:54:40.938938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:54:40.938938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:54:40.944272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b3fc8-77e9-4cec-adfc-95b9929bffda None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:41.031091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3fbcc-1006-466c-80b1-a0752856b0e2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:41.038730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b3fc8-77e9-4cec-adfc-95b9929bffda None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:41.062380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9458a38-e635-41e4-ba87-c30603172d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:41.063024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9458a38-e635-41e4-ba87-c30603172d3a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:41.063295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9458a38-e635-41e4-ba87-c30603172d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:41.063580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9458a38-e635-41e4-ba87-c30603172d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:41.064397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9458a38-e635-41e4-ba87-c30603172d3a None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.domain.id=default, user.id=efb24a53849544a0bc7346ef2b1d8c20) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:41.064703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9458a38-e635-41e4-ba87-c30603172d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:41.066144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9458a38-e635-41e4-ba87-c30603172d3a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:41.071461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe440f5-6a93-4569-9d88-640856de72a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:41.072117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe440f5-6a93-4569-9d88-640856de72a1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:41.072401 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe440f5-6a93-4569-9d88-640856de72a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:41.072672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe440f5-6a93-4569-9d88-640856de72a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:41.073106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Mon May 16 14:54:40 2022] GET /identity/v3/role_assignments?user.id=efb24a53849544a0bc7346ef2b1d8c20&scope.domain.id=default&role.id=042169a166e14a80beac826291ceaf73 => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:54:41.073386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe440f5-6a93-4569-9d88-640856de72a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:41.073690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe440f5-6a93-4569-9d88-640856de72a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:41.077119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe440f5-6a93-4569-9d88-640856de72a1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:41.094642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:54:43.663833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e64d40-0dec-470b-8513-a57bc15c64cc None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:43.664352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e64d40-0dec-470b-8513-a57bc15c64cc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:43.664352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e64d40-0dec-470b-8513-a57bc15c64cc None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:43.665996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:43.683862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecf92f-0da6-433b-9f13-3730d09e2f02 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:43.684348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecf92f-0da6-433b-9f13-3730d09e2f02 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:43.684423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecf92f-0da6-433b-9f13-3730d09e2f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:43.706079 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-20ecf92f-0da6-433b-9f13-3730d09e2f02 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:43.707857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-20ecf92f-0da6-433b-9f13-3730d09e2f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:43.785267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:43.819295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e64d40-0dec-470b-8513-a57bc15c64cc None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:43.831954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043acaba-c377-4dca-bb3a-3fd3642ff9d7 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:43.832244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043acaba-c377-4dca-bb3a-3fd3642ff9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:43.832529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043acaba-c377-4dca-bb3a-3fd3642ff9d7 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:43.836292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 12/24] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:43.839807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a189ecf-5ea5-474c-9722-34c95f395a52 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:43.840093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a189ecf-5ea5-474c-9722-34c95f395a52 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:43.840371 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a189ecf-5ea5-474c-9722-34c95f395a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:43.879882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5a189ecf-5ea5-474c-9722-34c95f395a52 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:43.881086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5a189ecf-5ea5-474c-9722-34c95f395a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:44.013407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:44.020278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e64d40-0dec-470b-8513-a57bc15c64cc None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:44.051935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a189ecf-5ea5-474c-9722-34c95f395a52 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:44.068937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c63b80-3c68-45c4-a0e4-eb6cdb54dc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:44.069751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c63b80-3c68-45c4-a0e4-eb6cdb54dc42 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.070028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c63b80-3c68-45c4-a0e4-eb6cdb54dc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.070322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c63b80-3c68-45c4-a0e4-eb6cdb54dc42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.095243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c63b80-3c68-45c4-a0e4-eb6cdb54dc42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c6c63b80-3c68-45c4-a0e4-eb6cdb54dc42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:54:44.111072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:54:44.111922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:54:44.112670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 13/26] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:54:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:54:44.118707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c63b80-3c68-45c4-a0e4-eb6cdb54dc42 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:44.205933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a189ecf-5ea5-474c-9722-34c95f395a52 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:44.248003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae903b-08fe-4a16-83bd-2ba9394d5780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:44.248803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae903b-08fe-4a16-83bd-2ba9394d5780 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.249090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae903b-08fe-4a16-83bd-2ba9394d5780 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.249367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae903b-08fe-4a16-83bd-2ba9394d5780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.271147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae903b-08fe-4a16-83bd-2ba9394d5780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:44.272573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae903b-08fe-4a16-83bd-2ba9394d5780 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-a6ae903b-08fe-4a16-83bd-2ba9394d5780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:54:44.312717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:54:44.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:54:44.318037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:54:44.318037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:54:44.318037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:54:44.318037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:54:44.318037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 14/27] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:54:44.325352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae903b-08fe-4a16-83bd-2ba9394d5780 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:44.341376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c63b80-3c68-45c4-a0e4-eb6cdb54dc42 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:44.414852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a234b5-44d5-4f8e-b2c9-8983d8525631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:44.415634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a234b5-44d5-4f8e-b2c9-8983d8525631 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.415913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a234b5-44d5-4f8e-b2c9-8983d8525631 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.416183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a234b5-44d5-4f8e-b2c9-8983d8525631 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.416948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a234b5-44d5-4f8e-b2c9-8983d8525631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:44.417248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a234b5-44d5-4f8e-b2c9-8983d8525631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:44.418673 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a234b5-44d5-4f8e-b2c9-8983d8525631 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:44.433872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 14/28] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:54:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:54:44.439502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a234b5-44d5-4f8e-b2c9-8983d8525631 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:44.469643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae903b-08fe-4a16-83bd-2ba9394d5780 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:44.514810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f5de2-716c-4619-bfcb-bf91148d189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:44.515503 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5de2-716c-4619-bfcb-bf91148d189c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.515793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5de2-716c-4619-bfcb-bf91148d189c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.516072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5de2-716c-4619-bfcb-bf91148d189c None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.516814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f5de2-716c-4619-bfcb-bf91148d189c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:44.517125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f5de2-716c-4619-bfcb-bf91148d189c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:44.518555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f5de2-716c-4619-bfcb-bf91148d189c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:44.532389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 15/29] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:44.533766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2767f4-460f-4f53-973a-1b2513445c44 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.534076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2767f4-460f-4f53-973a-1b2513445c44 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.534380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2767f4-460f-4f53-973a-1b2513445c44 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.542630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:44.543537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2767f4-460f-4f53-973a-1b2513445c44 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:44.551276 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a234b5-44d5-4f8e-b2c9-8983d8525631 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:44.586034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80909c99-149e-4528-9c54-2b0751bfd839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:44.587333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909c99-149e-4528-9c54-2b0751bfd839 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.587872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909c99-149e-4528-9c54-2b0751bfd839 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.588343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909c99-149e-4528-9c54-2b0751bfd839 None admin] PATH_INFO: `/v3/users/efb24a53849544a0bc7346ef2b1d8c20` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.589773 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80909c99-149e-4528-9c54-2b0751bfd839 None admin] RBAC: Authorizing `identity:get_user(user_id=efb24a53849544a0bc7346ef2b1d8c20)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:44.591534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80909c99-149e-4528-9c54-2b0751bfd839 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:44.593792 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 15/31] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:54:44 2022] GET /identity/v3/users/efb24a53849544a0bc7346ef2b1d8c20 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:54:44.595336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8074ba-7ee2-4274-8198-88ed53c9eb6c None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.595823 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8074ba-7ee2-4274-8198-88ed53c9eb6c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.596310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8074ba-7ee2-4274-8198-88ed53c9eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.615104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2c8074ba-7ee2-4274-8198-88ed53c9eb6c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:44.616712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2c8074ba-7ee2-4274-8198-88ed53c9eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:44.653461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2767f4-460f-4f53-973a-1b2513445c44 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:44.686261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 16/32] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:44.688331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6935-91c3-44c1-b62b-9bb3bcbcf136 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.688817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6935-91c3-44c1-b62b-9bb3bcbcf136 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.689288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6935-91c3-44c1-b62b-9bb3bcbcf136 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.689775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefa3ef-6491-4f0e-bd15-876f0027318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:44.690464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa3ef-6491-4f0e-bd15-876f0027318e None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.690751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa3ef-6491-4f0e-bd15-876f0027318e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.691025 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa3ef-6491-4f0e-bd15-876f0027318e None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.692645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefa3ef-6491-4f0e-bd15-876f0027318e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:44.696935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefa3ef-6491-4f0e-bd15-876f0027318e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:44.697190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 17/33] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:44.698238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac6935-91c3-44c1-b62b-9bb3bcbcf136 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:44.796692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac6935-91c3-44c1-b62b-9bb3bcbcf136 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:44.830770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f368a6-6a3d-4f0d-a0d7-87d7396298b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:44.831908 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f368a6-6a3d-4f0d-a0d7-87d7396298b5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.832385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f368a6-6a3d-4f0d-a0d7-87d7396298b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.832865 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f368a6-6a3d-4f0d-a0d7-87d7396298b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.834254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f368a6-6a3d-4f0d-a0d7-87d7396298b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:44.836133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f368a6-6a3d-4f0d-a0d7-87d7396298b5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:44.837954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 18/34] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:54:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:44.839301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27215-d762-4845-aa29-eafda57f783d None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.839781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27215-d762-4845-aa29-eafda57f783d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.840251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27215-d762-4845-aa29-eafda57f783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.857570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-71f27215-d762-4845-aa29-eafda57f783d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:44.859050 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-71f27215-d762-4845-aa29-eafda57f783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:44.906088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 17/35] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:54:44 2022] POST /identity/v3/projects => generated 301 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:54:44.906088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefa3ef-6491-4f0e-bd15-876f0027318e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:44.945393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 19/36] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:44.946859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d3c7-8357-4ed1-bbd8-5e8d0e8b7a80 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:44.947151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d3c7-8357-4ed1-bbd8-5e8d0e8b7a80 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:44.947439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d3c7-8357-4ed1-bbd8-5e8d0e8b7a80 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:44.950157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 20/37] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:44.950870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d3c7-8357-4ed1-bbd8-5e8d0e8b7a80 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:45.023479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefa3ef-6491-4f0e-bd15-876f0027318e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:45.060267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205389e-508a-45b2-947d-b2d8044895f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:45.060973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205389e-508a-45b2-947d-b2d8044895f3 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:45.061361 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205389e-508a-45b2-947d-b2d8044895f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:45.061706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205389e-508a-45b2-947d-b2d8044895f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:45.062671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205389e-508a-45b2-947d-b2d8044895f3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:45.064339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205389e-508a-45b2-947d-b2d8044895f3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:45.065557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d3c7-8357-4ed1-bbd8-5e8d0e8b7a80 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:45.103544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d692b8-300e-4c2f-9e49-b41d90eb9476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:45.104385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d692b8-300e-4c2f-9e49-b41d90eb9476 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:45.104670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d692b8-300e-4c2f-9e49-b41d90eb9476 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:45.104952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d692b8-300e-4c2f-9e49-b41d90eb9476 None admin] PATH_INFO: `/v3/domains/default/users/efb24a53849544a0bc7346ef2b1d8c20/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:45.107107 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d692b8-300e-4c2f-9e49-b41d90eb9476 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=efb24a53849544a0bc7346ef2b1d8c20, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:45.108582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d692b8-300e-4c2f-9e49-b41d90eb9476 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:45.165298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 18/38] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 16 14:54:44 2022] POST /identity/v3/roles => generated 219 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:54:45.167273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f1c7-04d2-4cd8-9ff8-13e26e76a331 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:45.167727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f1c7-04d2-4cd8-9ff8-13e26e76a331 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:45.168160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f1c7-04d2-4cd8-9ff8-13e26e76a331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:45.187570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c691f1c7-04d2-4cd8-9ff8-13e26e76a331 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:45.189199 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c691f1c7-04d2-4cd8-9ff8-13e26e76a331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:45.270068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 19/39] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:45.276978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f1c7-04d2-4cd8-9ff8-13e26e76a331 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:45.336370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 21/40] 10.222.0.44 () {58 vars in 1361 bytes} [Mon May 16 14:54:44 2022] PUT /identity/v3/domains/default/users/efb24a53849544a0bc7346ef2b1d8c20/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:54:45.337705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d692b8-300e-4c2f-9e49-b41d90eb9476 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:45.430943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f1c7-04d2-4cd8-9ff8-13e26e76a331 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:45.464677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d692b8-300e-4c2f-9e49-b41d90eb9476 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:45.468963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d5d27-8e1a-4c56-8fb7-aa54e20dbe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:45.469958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5d27-8e1a-4c56-8fb7-aa54e20dbe03 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:45.470422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5d27-8e1a-4c56-8fb7-aa54e20dbe03 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:45.470852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5d27-8e1a-4c56-8fb7-aa54e20dbe03 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:45.471789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d5d27-8e1a-4c56-8fb7-aa54e20dbe03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:45.473918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d5d27-8e1a-4c56-8fb7-aa54e20dbe03 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:45.506481 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60338a17-2384-4f4f-93dd-f655652f47f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:45.507184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338a17-2384-4f4f-93dd-f655652f47f9 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:45.507470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338a17-2384-4f4f-93dd-f655652f47f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:45.507752 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338a17-2384-4f4f-93dd-f655652f47f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:45.508528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60338a17-2384-4f4f-93dd-f655652f47f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:45.510225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60338a17-2384-4f4f-93dd-f655652f47f9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:45.544082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 16 14:54:45 2022] POST /identity/v3/roles => generated 225 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:54:45.610797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374a966-af79-41e0-9731-7c2ab43728ab None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:45.611302 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374a966-af79-41e0-9731-7c2ab43728ab None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:45.611751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374a966-af79-41e0-9731-7c2ab43728ab None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:45.613399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 21/42] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:54:45.619514 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8d593-9053-4bbf-9d3f-84b464fb46ce None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:45.620007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8d593-9053-4bbf-9d3f-84b464fb46ce None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:45.620434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8d593-9053-4bbf-9d3f-84b464fb46ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:45.623601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 22/43] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 16 14:54:45 2022] POST /identity/v3/roles => generated 223 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:54:45.639051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-79f8d593-9053-4bbf-9d3f-84b464fb46ce None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:45.640299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-79f8d593-9053-4bbf-9d3f-84b464fb46ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:45.725725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 22/44] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:54:45.749566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60338a17-2384-4f4f-93dd-f655652f47f9 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:45.855493 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60338a17-2384-4f4f-93dd-f655652f47f9 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:45.889315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454fbbb-f246-4d1b-8c02-487a2a7317cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:45.890045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454fbbb-f246-4d1b-8c02-487a2a7317cb None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:45.890369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454fbbb-f246-4d1b-8c02-487a2a7317cb None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:45.890649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454fbbb-f246-4d1b-8c02-487a2a7317cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:45.891922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454fbbb-f246-4d1b-8c02-487a2a7317cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:45.893383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454fbbb-f246-4d1b-8c02-487a2a7317cb None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:45.895587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 23/45] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:54:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:45.901129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8d593-9053-4bbf-9d3f-84b464fb46ce None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:45.996502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8d593-9053-4bbf-9d3f-84b464fb46ce None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:46.029217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624a28b-3f7d-49f9-b14f-2bdc93ae24b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:46.029879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624a28b-3f7d-49f9-b14f-2bdc93ae24b2 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:46.030188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624a28b-3f7d-49f9-b14f-2bdc93ae24b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:46.030466 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624a28b-3f7d-49f9-b14f-2bdc93ae24b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:46.031189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624a28b-3f7d-49f9-b14f-2bdc93ae24b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:46.032674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624a28b-3f7d-49f9-b14f-2bdc93ae24b2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:46.123596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 23/46] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:54:45 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:54:47.600014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c15091-e1c8-44e1-b7e3-3b48ea2e41ab None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:47.600545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c15091-e1c8-44e1-b7e3-3b48ea2e41ab None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:47.600629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c15091-e1c8-44e1-b7e3-3b48ea2e41ab None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:47.601945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 24/47] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:47.607188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ac3f-5aa9-42a2-b5c6-075328b0aa2c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:47.607596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ac3f-5aa9-42a2-b5c6-075328b0aa2c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:47.607740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ac3f-5aa9-42a2-b5c6-075328b0aa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:47.623842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7562ac3f-5aa9-42a2-b5c6-075328b0aa2c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:47.625014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7562ac3f-5aa9-42a2-b5c6-075328b0aa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:47.687172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 24/48] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:47.710531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c15091-e1c8-44e1-b7e3-3b48ea2e41ab None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:47.805633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c15091-e1c8-44e1-b7e3-3b48ea2e41ab None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:47.837036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a73f87-c68f-4438-a08d-33bb9bea3bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:47.837821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a73f87-c68f-4438-a08d-33bb9bea3bab None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:47.838133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a73f87-c68f-4438-a08d-33bb9bea3bab None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:47.838409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a73f87-c68f-4438-a08d-33bb9bea3bab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:47.848068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a73f87-c68f-4438-a08d-33bb9bea3bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-75a73f87-c68f-4438-a08d-33bb9bea3bab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:54:47.855608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:54:47.856573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:54:47.857385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 25/49] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:54:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:54:47.862591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562ac3f-5aa9-42a2-b5c6-075328b0aa2c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:47.954547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562ac3f-5aa9-42a2-b5c6-075328b0aa2c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:47.985706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a238fd-b3d9-427f-8ae0-bab08df584cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:47.986390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a238fd-b3d9-427f-8ae0-bab08df584cc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:47.986672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a238fd-b3d9-427f-8ae0-bab08df584cc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:47.986945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a238fd-b3d9-427f-8ae0-bab08df584cc None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:47.987687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a238fd-b3d9-427f-8ae0-bab08df584cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:47.988511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a238fd-b3d9-427f-8ae0-bab08df584cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:47.989897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a238fd-b3d9-427f-8ae0-bab08df584cc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:48.001026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 25/50] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:54:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:48.007016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a73f87-c68f-4438-a08d-33bb9bea3bab None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:48.100358 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a73f87-c68f-4438-a08d-33bb9bea3bab None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:48.132432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be3e4-7026-45a2-b2a9-218627f0af60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:48.133248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be3e4-7026-45a2-b2a9-218627f0af60 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:48.133535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be3e4-7026-45a2-b2a9-218627f0af60 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:48.133811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be3e4-7026-45a2-b2a9-218627f0af60 None admin] PATH_INFO: `/v3/users/efb24a53849544a0bc7346ef2b1d8c20` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:48.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824be3e4-7026-45a2-b2a9-218627f0af60 None admin] RBAC: Authorizing `identity:get_user(user_id=efb24a53849544a0bc7346ef2b1d8c20)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:48.136570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824be3e4-7026-45a2-b2a9-218627f0af60 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:48.138326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 26/51] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:54:48 2022] GET /identity/v3/users/efb24a53849544a0bc7346ef2b1d8c20 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:48.143950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a238fd-b3d9-427f-8ae0-bab08df584cc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:48.240291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a238fd-b3d9-427f-8ae0-bab08df584cc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:48.270586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75fd0e-4ca6-49fa-ac85-528b9177345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:48.271374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fd0e-4ca6-49fa-ac85-528b9177345d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:48.271654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fd0e-4ca6-49fa-ac85-528b9177345d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:48.271923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fd0e-4ca6-49fa-ac85-528b9177345d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:48.273079 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75fd0e-4ca6-49fa-ac85-528b9177345d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:48.274557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75fd0e-4ca6-49fa-ac85-528b9177345d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:48.276318 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 26/52] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:54:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:48.281797 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be3e4-7026-45a2-b2a9-218627f0af60 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:48.329655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc362306-a9ca-4cfa-b5e9-a83a0478d1d9 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:48.329940 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc362306-a9ca-4cfa-b5e9-a83a0478d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:48.330240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc362306-a9ca-4cfa-b5e9-a83a0478d1d9 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:48.331617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 27/53] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:54:48.336972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08af48b-8762-407f-8da2-ce4a9bd496c9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:48.337267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08af48b-8762-407f-8da2-ce4a9bd496c9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:48.337551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08af48b-8762-407f-8da2-ce4a9bd496c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:48.354437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e08af48b-8762-407f-8da2-ce4a9bd496c9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:48.355637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e08af48b-8762-407f-8da2-ce4a9bd496c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:48.377000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be3e4-7026-45a2-b2a9-218627f0af60 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:48.408221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6cd0c-b28d-4204-86d7-a4adce13d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:48.408805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6cd0c-b28d-4204-86d7-a4adce13d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:48.409211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6cd0c-b28d-4204-86d7-a4adce13d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:48.409491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6cd0c-b28d-4204-86d7-a4adce13d0e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:48.410873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6cd0c-b28d-4204-86d7-a4adce13d0e1 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.domain.id=default, user.id=efb24a53849544a0bc7346ef2b1d8c20) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:48.411182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6cd0c-b28d-4204-86d7-a4adce13d0e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:48.412624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6cd0c-b28d-4204-86d7-a4adce13d0e1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:48.418232 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 27/54] 10.222.0.44 () {56 vars in 1322 bytes} [Mon May 16 14:54:48 2022] GET /identity/v3/role_assignments?user.id=efb24a53849544a0bc7346ef2b1d8c20&scope.domain.id=default&role.id=042169a166e14a80beac826291ceaf73 => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:48.419068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 28/55] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:54:48.444103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6cd0c-b28d-4204-86d7-a4adce13d0e1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:48.545149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6cd0c-b28d-4204-86d7-a4adce13d0e1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:48.578776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89042168-b895-42ec-97bf-86c7a2e5521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:48.579578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042168-b895-42ec-97bf-86c7a2e5521f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:48.579860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042168-b895-42ec-97bf-86c7a2e5521f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:48.580130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042168-b895-42ec-97bf-86c7a2e5521f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:48.581421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89042168-b895-42ec-97bf-86c7a2e5521f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:48.583545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89042168-b895-42ec-97bf-86c7a2e5521f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:48.585660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 28/56] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:54:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:48.591327 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08af48b-8762-407f-8da2-ce4a9bd496c9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:48.689798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08af48b-8762-407f-8da2-ce4a9bd496c9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:48.720948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd8119-3e7f-4b24-9e5c-734b25e258bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:48.726709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd8119-3e7f-4b24-9e5c-734b25e258bf None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:48.726709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd8119-3e7f-4b24-9e5c-734b25e258bf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:48.726709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd8119-3e7f-4b24-9e5c-734b25e258bf None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:48.726709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd8119-3e7f-4b24-9e5c-734b25e258bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:48.726709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd8119-3e7f-4b24-9e5c-734b25e258bf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:48.822156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 29/57] 10.222.0.44 () {60 vars in 1140 bytes} [Mon May 16 14:54:48 2022] POST /identity/v3/projects => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:54:51.016689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60207cf-3602-4fa3-b3b1-5734a01c9aaf None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:51.017199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60207cf-3602-4fa3-b3b1-5734a01c9aaf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:51.017286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60207cf-3602-4fa3-b3b1-5734a01c9aaf None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:51.018661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 29/58] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:51.024043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f505d5-0af4-4050-8115-e400aa126c4a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:51.024446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f505d5-0af4-4050-8115-e400aa126c4a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:51.024601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f505d5-0af4-4050-8115-e400aa126c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:51.041211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b1f505d5-0af4-4050-8115-e400aa126c4a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:51.042395 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b1f505d5-0af4-4050-8115-e400aa126c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:51.104537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 30/59] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:51.129108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60207cf-3602-4fa3-b3b1-5734a01c9aaf None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:51.223184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60207cf-3602-4fa3-b3b1-5734a01c9aaf None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:51.254306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3bfe8-6201-49b4-930f-ca3bd892f408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:51.255076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3bfe8-6201-49b4-930f-ca3bd892f408 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:51.255360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3bfe8-6201-49b4-930f-ca3bd892f408 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:51.255642 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3bfe8-6201-49b4-930f-ca3bd892f408 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:51.256788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3bfe8-6201-49b4-930f-ca3bd892f408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:51.258249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3bfe8-6201-49b4-930f-ca3bd892f408 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:51.259832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 30/60] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:54:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:51.265199 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f505d5-0af4-4050-8115-e400aa126c4a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:51.356443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f505d5-0af4-4050-8115-e400aa126c4a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:51.388238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2843b-4359-4a1a-a791-28769cf7286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:51.388893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2843b-4359-4a1a-a791-28769cf7286c None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:51.389173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2843b-4359-4a1a-a791-28769cf7286c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:51.389445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2843b-4359-4a1a-a791-28769cf7286c None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:51.390160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2843b-4359-4a1a-a791-28769cf7286c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:51.391593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2843b-4359-4a1a-a791-28769cf7286c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:51.491332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 31/61] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:54:51 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:54:54.816397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbb96e-89cb-433e-b6de-1f4c21ac20c0 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:54.816963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbb96e-89cb-433e-b6de-1f4c21ac20c0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:54.816963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbb96e-89cb-433e-b6de-1f4c21ac20c0 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:54.818365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 31/62] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:54.832118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd358-142d-4c5d-b97b-79d1665f32b9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:54.833008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd358-142d-4c5d-b97b-79d1665f32b9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:54.833490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dd358-142d-4c5d-b97b-79d1665f32b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:54.855165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e64dd358-142d-4c5d-b97b-79d1665f32b9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:54.856776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e64dd358-142d-4c5d-b97b-79d1665f32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:54.941329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 32/63] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:54.987824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbb96e-89cb-433e-b6de-1f4c21ac20c0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:54.997345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57c3b0-1f07-47c6-9854-32612bf5e7b5 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:54.998103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57c3b0-1f07-47c6-9854-32612bf5e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:54.998711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57c3b0-1f07-47c6-9854-32612bf5e7b5 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.000551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 33/64] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:54:55.007353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e1c28-53e4-48c5-9e6e-583b5c3fdaae None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.008004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e1c28-53e4-48c5-9e6e-583b5c3fdaae None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.008652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e1c28-53e4-48c5-9e6e-583b5c3fdaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.034109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ab2e1c28-53e4-48c5-9e6e-583b5c3fdaae None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:55.036214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ab2e1c28-53e4-48c5-9e6e-583b5c3fdaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:55.129499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 34/65] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:54:55.135657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27066ed3-fad1-4a2c-809f-44b8605a6def None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.135881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27066ed3-fad1-4a2c-809f-44b8605a6def None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.136097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27066ed3-fad1-4a2c-809f-44b8605a6def None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.137540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 35/66] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:55.143711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58695ae3-4864-4562-b463-dd08769ebc52 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.144549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58695ae3-4864-4562-b463-dd08769ebc52 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.144822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58695ae3-4864-4562-b463-dd08769ebc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.164692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbb96e-89cb-433e-b6de-1f4c21ac20c0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:55.168395 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-58695ae3-4864-4562-b463-dd08769ebc52 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:55.169916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-58695ae3-4864-4562-b463-dd08769ebc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:55.209950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98603a1b-7392-4ba3-abfc-8dcf3365d93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:55.211361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98603a1b-7392-4ba3-abfc-8dcf3365d93d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.211829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98603a1b-7392-4ba3-abfc-8dcf3365d93d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.212282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98603a1b-7392-4ba3-abfc-8dcf3365d93d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.222987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98603a1b-7392-4ba3-abfc-8dcf3365d93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-98603a1b-7392-4ba3-abfc-8dcf3365d93d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:54:55.231078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:54:55.231970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:54:55.232747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:54:55.235101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 32/67] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:54:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:54:55.236088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98603a1b-7392-4ba3-abfc-8dcf3365d93d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:55.239447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 36/68] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:55.240827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58695ae3-4864-4562-b463-dd08769ebc52 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:55.356511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58695ae3-4864-4562-b463-dd08769ebc52 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:55.381749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98603a1b-7392-4ba3-abfc-8dcf3365d93d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:55.393369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf15da-fcde-42d5-b465-d209f0e1acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:55.394141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf15da-fcde-42d5-b465-d209f0e1acb0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.394430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf15da-fcde-42d5-b465-d209f0e1acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.394720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf15da-fcde-42d5-b465-d209f0e1acb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.395523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf15da-fcde-42d5-b465-d209f0e1acb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:55.395834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf15da-fcde-42d5-b465-d209f0e1acb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:55.397258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf15da-fcde-42d5-b465-d209f0e1acb0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:55.405115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 37/69] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:54:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:54:55.405903 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf15da-fcde-42d5-b465-d209f0e1acb0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:55.415043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b1e4-16a4-496c-b167-6f445b3f75c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:55.415837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b1e4-16a4-496c-b167-6f445b3f75c2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.416122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b1e4-16a4-496c-b167-6f445b3f75c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.416392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b1e4-16a4-496c-b167-6f445b3f75c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.426995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87b1e4-16a4-496c-b167-6f445b3f75c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-2b87b1e4-16a4-496c-b167-6f445b3f75c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:54:55.434446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:54:55.435277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:54:55.436036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 33/70] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:54:55.437175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda43ca-3629-4f87-b7e1-5a8e3069c416 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.437175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda43ca-3629-4f87-b7e1-5a8e3069c416 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.437393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda43ca-3629-4f87-b7e1-5a8e3069c416 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.438780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 34/71] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:55.439419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda43ca-3629-4f87-b7e1-5a8e3069c416 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:55.515324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf15da-fcde-42d5-b465-d209f0e1acb0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:55.535600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda43ca-3629-4f87-b7e1-5a8e3069c416 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:55.546938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c63bdb-c2d0-48e6-bc92-b2eb32644b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:55.547746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c63bdb-c2d0-48e6-bc92-b2eb32644b3c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.548032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c63bdb-c2d0-48e6-bc92-b2eb32644b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.548309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c63bdb-c2d0-48e6-bc92-b2eb32644b3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.560814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c63bdb-c2d0-48e6-bc92-b2eb32644b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:54:55.568169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60422642-8b96-42ba-a78a-83496bcda79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:55.569025 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60422642-8b96-42ba-a78a-83496bcda79a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.569307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60422642-8b96-42ba-a78a-83496bcda79a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.569581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60422642-8b96-42ba-a78a-83496bcda79a None admin] PATH_INFO: `/v3/users/d4261f09bd3e4098acde3ccdf5841591` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c8c63bdb-c2d0-48e6-bc92-b2eb32644b3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:54:55.570646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:54:55.571529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:54:55.572279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 38/72] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:54:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:54:55.572902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c63bdb-c2d0-48e6-bc92-b2eb32644b3c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:55.585791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60422642-8b96-42ba-a78a-83496bcda79a None admin] RBAC: Authorizing `identity:get_user(user_id=d4261f09bd3e4098acde3ccdf5841591)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:55.587290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60422642-8b96-42ba-a78a-83496bcda79a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:55.588972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 35/73] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:54:55 2022] GET /identity/v3/users/d4261f09bd3e4098acde3ccdf5841591 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:55.590239 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897913d6-1111-47e2-9415-c52cf7ad16d6 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.590524 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897913d6-1111-47e2-9415-c52cf7ad16d6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.590802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897913d6-1111-47e2-9415-c52cf7ad16d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.606002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-897913d6-1111-47e2-9415-c52cf7ad16d6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:55.607558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-897913d6-1111-47e2-9415-c52cf7ad16d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:55.664084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c63bdb-c2d0-48e6-bc92-b2eb32644b3c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:55.668607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 36/74] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:55.669937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2a41-8d10-4434-a15b-f35eaf252f04 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.670262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2a41-8d10-4434-a15b-f35eaf252f04 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.670536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2a41-8d10-4434-a15b-f35eaf252f04 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.671788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 37/75] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:54:55.672717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2a41-8d10-4434-a15b-f35eaf252f04 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:55.696251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be1025-6032-4287-9a42-2677e1164f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:55.696916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be1025-6032-4287-9a42-2677e1164f0f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.697197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be1025-6032-4287-9a42-2677e1164f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.697471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be1025-6032-4287-9a42-2677e1164f0f None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.698247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be1025-6032-4287-9a42-2677e1164f0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:55.698556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be1025-6032-4287-9a42-2677e1164f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:55.699941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be1025-6032-4287-9a42-2677e1164f0f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:55.712358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 39/76] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:55.712358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be1025-6032-4287-9a42-2677e1164f0f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:55.780419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2a41-8d10-4434-a15b-f35eaf252f04 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:55.799265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be1025-6032-4287-9a42-2677e1164f0f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:55.812521 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b5826-562e-4134-b302-e8007ba143e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:55.813191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b5826-562e-4134-b302-e8007ba143e7 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.813475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b5826-562e-4134-b302-e8007ba143e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.813750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b5826-562e-4134-b302-e8007ba143e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.814534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b5826-562e-4134-b302-e8007ba143e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:55.814845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b5826-562e-4134-b302-e8007ba143e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:55.816260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b5826-562e-4134-b302-e8007ba143e7 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:55.823814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 38/77] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:54:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:55.824965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4058fea-086e-4c1b-a66f-ac0b48dff2c5 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.825418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4058fea-086e-4c1b-a66f-ac0b48dff2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.825851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4058fea-086e-4c1b-a66f-ac0b48dff2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.831784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a268145-d2c4-4747-bf19-55396ca16293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:55.832437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a268145-d2c4-4747-bf19-55396ca16293 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:55.832934 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a268145-d2c4-4747-bf19-55396ca16293 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:55.833028 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a268145-d2c4-4747-bf19-55396ca16293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:55.842126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c4058fea-086e-4c1b-a66f-ac0b48dff2c5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:54:55.843286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c4058fea-086e-4c1b-a66f-ac0b48dff2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:54:55.896378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a268145-d2c4-4747-bf19-55396ca16293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:55.897772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a268145-d2c4-4747-bf19-55396ca16293 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:55.904102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 39/78] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:54:55.904912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4058fea-086e-4c1b-a66f-ac0b48dff2c5 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:55.990084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 40/79] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:54:55.990926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a268145-d2c4-4747-bf19-55396ca16293 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:55.995805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4058fea-086e-4c1b-a66f-ac0b48dff2c5 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.028236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b6cfd-713d-463f-9e36-a992a6d89cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.029026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b6cfd-713d-463f-9e36-a992a6d89cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.029309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b6cfd-713d-463f-9e36-a992a6d89cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.029583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b6cfd-713d-463f-9e36-a992a6d89cc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.039084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b6cfd-713d-463f-9e36-a992a6d89cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-217b6cfd-713d-463f-9e36-a992a6d89cc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:54:56.046627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:54:56.047541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 40/80] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:54:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:54:56.053671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b6cfd-713d-463f-9e36-a992a6d89cc8 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.083818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a268145-d2c4-4747-bf19-55396ca16293 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.115875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b974737-252a-40eb-8200-7108da251d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.116733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974737-252a-40eb-8200-7108da251d0d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.117017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974737-252a-40eb-8200-7108da251d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.117290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974737-252a-40eb-8200-7108da251d0d None admin] PATH_INFO: `/v3/users/efb24a53849544a0bc7346ef2b1d8c20` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.118727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b974737-252a-40eb-8200-7108da251d0d None admin] RBAC: Authorizing `identity:get_user(user_id=efb24a53849544a0bc7346ef2b1d8c20)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.120189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b974737-252a-40eb-8200-7108da251d0d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.121820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 41/81] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:54:55 2022] GET /identity/v3/users/efb24a53849544a0bc7346ef2b1d8c20 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:56.122610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b974737-252a-40eb-8200-7108da251d0d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.141968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b6cfd-713d-463f-9e36-a992a6d89cc8 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.172889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b355-2b0a-400f-a38a-2d51f245fd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.173795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b355-2b0a-400f-a38a-2d51f245fd7f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.174159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b355-2b0a-400f-a38a-2d51f245fd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.174442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31b355-2b0a-400f-a38a-2d51f245fd7f None admin] PATH_INFO: `/v3/users/d4261f09bd3e4098acde3ccdf5841591` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.176206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31b355-2b0a-400f-a38a-2d51f245fd7f None admin] RBAC: Authorizing `identity:get_user(user_id=d4261f09bd3e4098acde3ccdf5841591)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.177661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31b355-2b0a-400f-a38a-2d51f245fd7f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.179341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 41/82] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/users/d4261f09bd3e4098acde3ccdf5841591 => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:56.180104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b355-2b0a-400f-a38a-2d51f245fd7f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.222776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b974737-252a-40eb-8200-7108da251d0d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.254581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6034a-c563-4007-abd4-4434111f0744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.255370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6034a-c563-4007-abd4-4434111f0744 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.255655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6034a-c563-4007-abd4-4434111f0744 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.255935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6034a-c563-4007-abd4-4434111f0744 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.257105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6034a-c563-4007-abd4-4434111f0744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.258598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6034a-c563-4007-abd4-4434111f0744 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.260234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 42/83] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:56.260991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6034a-c563-4007-abd4-4434111f0744 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.272649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31b355-2b0a-400f-a38a-2d51f245fd7f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.303921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ba8b9-16c6-44dc-ae7a-38bc3e11087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.304779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ba8b9-16c6-44dc-ae7a-38bc3e11087e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.305067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ba8b9-16c6-44dc-ae7a-38bc3e11087e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.305352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ba8b9-16c6-44dc-ae7a-38bc3e11087e None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.306575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ba8b9-16c6-44dc-ae7a-38bc3e11087e None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.308031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ba8b9-16c6-44dc-ae7a-38bc3e11087e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.314519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 42/84] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:56.314519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ba8b9-16c6-44dc-ae7a-38bc3e11087e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.353392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6034a-c563-4007-abd4-4434111f0744 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.384611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cff0c-0586-40b4-9a90-636fda75660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.385278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cff0c-0586-40b4-9a90-636fda75660a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.385565 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cff0c-0586-40b4-9a90-636fda75660a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.385844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cff0c-0586-40b4-9a90-636fda75660a None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.386612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cff0c-0586-40b4-9a90-636fda75660a None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:56.386922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cff0c-0586-40b4-9a90-636fda75660a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.388340 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cff0c-0586-40b4-9a90-636fda75660a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.396537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 43/85] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:56.397324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cff0c-0586-40b4-9a90-636fda75660a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.403120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ba8b9-16c6-44dc-ae7a-38bc3e11087e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.434037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff38aaa-0bc4-4425-9649-6a1f7dff22ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.434643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff38aaa-0bc4-4425-9649-6a1f7dff22ee None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.434923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff38aaa-0bc4-4425-9649-6a1f7dff22ee None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.435194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff38aaa-0bc4-4425-9649-6a1f7dff22ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.490815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cff0c-0586-40b4-9a90-636fda75660a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.496492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff38aaa-0bc4-4425-9649-6a1f7dff22ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.497954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff38aaa-0bc4-4425-9649-6a1f7dff22ee None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.522603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060c56a-7513-4097-8c91-8eab969652e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.523247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060c56a-7513-4097-8c91-8eab969652e0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.523533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060c56a-7513-4097-8c91-8eab969652e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.523812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060c56a-7513-4097-8c91-8eab969652e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.586652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060c56a-7513-4097-8c91-8eab969652e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.588140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060c56a-7513-4097-8c91-8eab969652e0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.588536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 43/86] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:54:56.589178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff38aaa-0bc4-4425-9649-6a1f7dff22ee None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.679305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff38aaa-0bc4-4425-9649-6a1f7dff22ee None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.680706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 44/87] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:54:56.681545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060c56a-7513-4097-8c91-8eab969652e0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.711236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93af7a-627f-43fe-97fa-22ea974d21ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.711837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93af7a-627f-43fe-97fa-22ea974d21ad None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.712127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93af7a-627f-43fe-97fa-22ea974d21ad None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.712408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93af7a-627f-43fe-97fa-22ea974d21ad None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.713132 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93af7a-627f-43fe-97fa-22ea974d21ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.714707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93af7a-627f-43fe-97fa-22ea974d21ad None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.772929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060c56a-7513-4097-8c91-8eab969652e0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.806073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1ba81-81ba-4abd-98c6-e5ece3bec19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.806728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1ba81-81ba-4abd-98c6-e5ece3bec19a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.807007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1ba81-81ba-4abd-98c6-e5ece3bec19a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.807280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1ba81-81ba-4abd-98c6-e5ece3bec19a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.808092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1ba81-81ba-4abd-98c6-e5ece3bec19a None admin] RBAC: Adding query filter params (role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=db8112f1b83d4722a9c6776f739c6c71, user.id=d4261f09bd3e4098acde3ccdf5841591) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:56.808402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1ba81-81ba-4abd-98c6-e5ece3bec19a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.809825 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1ba81-81ba-4abd-98c6-e5ece3bec19a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.817760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 45/88] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/role_assignments?user.id=d4261f09bd3e4098acde3ccdf5841591&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:56.818563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1ba81-81ba-4abd-98c6-e5ece3bec19a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.832711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 44/89] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:54:56 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:54:56.833593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93af7a-627f-43fe-97fa-22ea974d21ad None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.931031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1ba81-81ba-4abd-98c6-e5ece3bec19a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.946811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93af7a-627f-43fe-97fa-22ea974d21ad None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:56.969670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c8ac-5cc8-4273-891e-588d068e0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.970579 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c8ac-5cc8-4273-891e-588d068e0d72 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.970865 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c8ac-5cc8-4273-891e-588d068e0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.971140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c8ac-5cc8-4273-891e-588d068e0d72 None admin] PATH_INFO: `/v3/users/d4261f09bd3e4098acde3ccdf5841591` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.973234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86c8ac-5cc8-4273-891e-588d068e0d72 None admin] RBAC: Authorizing `identity:get_user(user_id=d4261f09bd3e4098acde3ccdf5841591)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.975001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86c8ac-5cc8-4273-891e-588d068e0d72 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.981627 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 46/90] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/users/d4261f09bd3e4098acde3ccdf5841591 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:56.982864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c8ac-5cc8-4273-891e-588d068e0d72 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:56.991657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aa74e-6c69-4d50-9d58-131ce1e2f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:56.992939 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aa74e-6c69-4d50-9d58-131ce1e2f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:56.993422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aa74e-6c69-4d50-9d58-131ce1e2f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:56.993897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aa74e-6c69-4d50-9d58-131ce1e2f2d1 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:56.995533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aa74e-6c69-4d50-9d58-131ce1e2f2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:56.997350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aa74e-6c69-4d50-9d58-131ce1e2f2d1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:56.999760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 45/91] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:57.000871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aa74e-6c69-4d50-9d58-131ce1e2f2d1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:57.107707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c8ac-5cc8-4273-891e-588d068e0d72 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:57.128070 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aa74e-6c69-4d50-9d58-131ce1e2f2d1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:57.157938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ac5c4-0660-4ea7-b4e6-8c918dbab2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:57.159077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ac5c4-0660-4ea7-b4e6-8c918dbab2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:57.159637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ac5c4-0660-4ea7-b4e6-8c918dbab2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:57.159917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ac5c4-0660-4ea7-b4e6-8c918dbab2f1 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:57.161476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ac5c4-0660-4ea7-b4e6-8c918dbab2f1 None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:57.163512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ac5c4-0660-4ea7-b4e6-8c918dbab2f1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:57.165187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 47/92] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:57.169998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ac5c4-0660-4ea7-b4e6-8c918dbab2f1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:57.170171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34db3-2e56-4f0a-be92-20c7eec7a1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:57.171184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34db3-2e56-4f0a-be92-20c7eec7a1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:57.171472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34db3-2e56-4f0a-be92-20c7eec7a1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:57.171750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e34db3-2e56-4f0a-be92-20c7eec7a1b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:57.257985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e34db3-2e56-4f0a-be92-20c7eec7a1b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:57.259491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e34db3-2e56-4f0a-be92-20c7eec7a1b4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:57.287538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ac5c4-0660-4ea7-b4e6-8c918dbab2f1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:57.340510 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077502a-661f-4cec-bf4a-72240fea2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:57.341330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077502a-661f-4cec-bf4a-72240fea2064 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:57.341710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077502a-661f-4cec-bf4a-72240fea2064 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:57.342079 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077502a-661f-4cec-bf4a-72240fea2064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:57.343689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077502a-661f-4cec-bf4a-72240fea2064 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=db8112f1b83d4722a9c6776f739c6c71, user.id=efb24a53849544a0bc7346ef2b1d8c20) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:57.343689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077502a-661f-4cec-bf4a-72240fea2064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:57.344757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077502a-661f-4cec-bf4a-72240fea2064 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:57.353445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 48/93] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:54:57 2022] GET /identity/v3/role_assignments?user.id=efb24a53849544a0bc7346ef2b1d8c20&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=042169a166e14a80beac826291ceaf73 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:57.354161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077502a-661f-4cec-bf4a-72240fea2064 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:57.405382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 46/94] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:54:57.413919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34db3-2e56-4f0a-be92-20c7eec7a1b4 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:57.585888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077502a-661f-4cec-bf4a-72240fea2064 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:57.635835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e34db3-2e56-4f0a-be92-20c7eec7a1b4 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:57.645413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f461b-1b7e-4124-855b-469a8f0d33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:57.646407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f461b-1b7e-4124-855b-469a8f0d33ac None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:57.646896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f461b-1b7e-4124-855b-469a8f0d33ac None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:57.647807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f461b-1b7e-4124-855b-469a8f0d33ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:57.648856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f461b-1b7e-4124-855b-469a8f0d33ac None admin] RBAC: Adding query filter params (role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=db8112f1b83d4722a9c6776f739c6c71, user.id=d4261f09bd3e4098acde3ccdf5841591) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:57.649424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f461b-1b7e-4124-855b-469a8f0d33ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:57.651136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f461b-1b7e-4124-855b-469a8f0d33ac None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:57.657479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 49/95] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:54:57 2022] GET /identity/v3/role_assignments?user.id=d4261f09bd3e4098acde3ccdf5841591&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=638115ca27864c64a0554c5c0913956a => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:57.725654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da2563-e7b0-46ae-a097-d5dff68f780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:57.726579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2563-e7b0-46ae-a097-d5dff68f780c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:57.726861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2563-e7b0-46ae-a097-d5dff68f780c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:57.727134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da2563-e7b0-46ae-a097-d5dff68f780c None admin] PATH_INFO: `/v3/projects/49b98da09136430a933535cf6fb4dfa9` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:57.730963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2563-e7b0-46ae-a097-d5dff68f780c None admin] RBAC: Authorizing `identity:get_project(project_id=49b98da09136430a933535cf6fb4dfa9)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:57.732502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da2563-e7b0-46ae-a097-d5dff68f780c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:57.734427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 47/96] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:54:57 2022] GET /identity/v3/projects/49b98da09136430a933535cf6fb4dfa9 => generated 312 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:54:57.740285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f461b-1b7e-4124-855b-469a8f0d33ac None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:54:57.851758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f461b-1b7e-4124-855b-469a8f0d33ac None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:54:57.887293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155be3f-302d-4d24-85b6-beab773d302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:54:57.887960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155be3f-302d-4d24-85b6-beab773d302b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:54:57.888247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155be3f-302d-4d24-85b6-beab773d302b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:54:57.888527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155be3f-302d-4d24-85b6-beab773d302b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:54:57.889364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155be3f-302d-4d24-85b6-beab773d302b None admin] RBAC: Adding query filter params (role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=49b98da09136430a933535cf6fb4dfa9, user.id=d4261f09bd3e4098acde3ccdf5841591) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:54:57.889682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155be3f-302d-4d24-85b6-beab773d302b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:54:57.891171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155be3f-302d-4d24-85b6-beab773d302b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:54:57.897612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 50/97] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:54:57 2022] GET /identity/v3/role_assignments?user.id=d4261f09bd3e4098acde3ccdf5841591&scope.project.id=49b98da09136430a933535cf6fb4dfa9&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:00.072425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f2378-5e69-45c0-bbc9-575f9e011654 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.072934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f2378-5e69-45c0-bbc9-575f9e011654 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.073008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f2378-5e69-45c0-bbc9-575f9e011654 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.076959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 48/98] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:00.089546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25a98-81db-42af-b56a-037c2d407078 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.089988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25a98-81db-42af-b56a-037c2d407078 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.090209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25a98-81db-42af-b56a-037c2d407078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.109674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ed082-2b96-4a3d-ab3c-dce4bab0227f None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.110396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ed082-2b96-4a3d-ab3c-dce4bab0227f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.110884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ed082-2b96-4a3d-ab3c-dce4bab0227f None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.112536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 49/99] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:00.119275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-10d25a98-81db-42af-b56a-037c2d407078 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:00.120719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-10d25a98-81db-42af-b56a-037c2d407078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:00.123208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9dc10-25af-4a40-bc93-c7780a391aaf None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.123710 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9dc10-25af-4a40-bc93-c7780a391aaf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.124178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9dc10-25af-4a40-bc93-c7780a391aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.160366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-91c9dc10-25af-4a40-bc93-c7780a391aaf None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:00.161939 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-91c9dc10-25af-4a40-bc93-c7780a391aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:00.221871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 51/100] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:00.262723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d25a98-81db-42af-b56a-037c2d407078 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:00.287412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 50/101] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:00.322165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9dc10-25af-4a40-bc93-c7780a391aaf None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:00.444673 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d25a98-81db-42af-b56a-037c2d407078 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:00.479379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9dc10-25af-4a40-bc93-c7780a391aaf None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:00.480484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f105ad-9c80-4e19-9c6f-923a4eb59fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:00.481536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f105ad-9c80-4e19-9c6f-923a4eb59fad None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.481969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f105ad-9c80-4e19-9c6f-923a4eb59fad None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.482409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f105ad-9c80-4e19-9c6f-923a4eb59fad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.483784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f105ad-9c80-4e19-9c6f-923a4eb59fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:00.485397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f105ad-9c80-4e19-9c6f-923a4eb59fad None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:00.487636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 52/102] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:00.489092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f16217-85e9-4ea3-bc15-aab099e44f5c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.489525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f16217-85e9-4ea3-bc15-aab099e44f5c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.489958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f16217-85e9-4ea3-bc15-aab099e44f5c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.491966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 53/103] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:00.493354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84dd44-1f26-478d-8a0e-62842483d8c2 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.493873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84dd44-1f26-478d-8a0e-62842483d8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.494402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84dd44-1f26-478d-8a0e-62842483d8c2 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.496378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 54/104] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:00.497292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84dd44-1f26-478d-8a0e-62842483d8c2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:00.517940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc79efe-cddb-45e8-8ed2-e3b526ba9f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:00.519716 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79efe-cddb-45e8-8ed2-e3b526ba9f10 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.520175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79efe-cddb-45e8-8ed2-e3b526ba9f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.520647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc79efe-cddb-45e8-8ed2-e3b526ba9f10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.530954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc79efe-cddb-45e8-8ed2-e3b526ba9f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-0fc79efe-cddb-45e8-8ed2-e3b526ba9f10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:00.539047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:00.539891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:00.540637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:00.543401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 51/105] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:00.544790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8376-b356-4bc9-8737-8025dca9ca8b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.545265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8376-b356-4bc9-8737-8025dca9ca8b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.545727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8376-b356-4bc9-8737-8025dca9ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.562880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c68a8376-b356-4bc9-8737-8025dca9ca8b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:00.564313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c68a8376-b356-4bc9-8737-8025dca9ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:00.605487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84dd44-1f26-478d-8a0e-62842483d8c2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:00.631097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 52/106] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:00.632695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88de2a-8678-4f39-a57d-25dffe3a55cc None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.633201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88de2a-8678-4f39-a57d-25dffe3a55cc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.633694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88de2a-8678-4f39-a57d-25dffe3a55cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.643472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b21d-54c9-4aa3-af46-18734b5ebef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:00.644166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b21d-54c9-4aa3-af46-18734b5ebef0 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.644452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b21d-54c9-4aa3-af46-18734b5ebef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.644722 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b21d-54c9-4aa3-af46-18734b5ebef0 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.645629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3b21d-54c9-4aa3-af46-18734b5ebef0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:00.647296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3b21d-54c9-4aa3-af46-18734b5ebef0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:00.650722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-aa88de2a-8678-4f39-a57d-25dffe3a55cc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:00.652118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-aa88de2a-8678-4f39-a57d-25dffe3a55cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:00.716907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 53/107] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:00.722181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88de2a-8678-4f39-a57d-25dffe3a55cc None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:00.749888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 55/108] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:55:00 2022] POST /identity/v3/projects => generated 302 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:00.752157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b21d-54c9-4aa3-af46-18734b5ebef0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:00.886219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b21d-54c9-4aa3-af46-18734b5ebef0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:00.909890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88de2a-8678-4f39-a57d-25dffe3a55cc None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:00.932323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f9f91-6d30-4629-97ad-5dca7cf790dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:00.933586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f9f91-6d30-4629-97ad-5dca7cf790dd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.934154 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f9f91-6d30-4629-97ad-5dca7cf790dd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.934702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f9f91-6d30-4629-97ad-5dca7cf790dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.961407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f9f91-6d30-4629-97ad-5dca7cf790dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-3c3f9f91-6d30-4629-97ad-5dca7cf790dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:00.978446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:00.979364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:00.980137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 56/109] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:00.980774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f9f91-6d30-4629-97ad-5dca7cf790dd None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:00.985487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f2f81-fd60-43eb-872f-f0860aa292e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:00.986214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f2f81-fd60-43eb-872f-f0860aa292e1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:00.986503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f2f81-fd60-43eb-872f-f0860aa292e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:00.986782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f2f81-fd60-43eb-872f-f0860aa292e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:00.989220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f2f81-fd60-43eb-872f-f0860aa292e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:00.989567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f2f81-fd60-43eb-872f-f0860aa292e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:00.991019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f2f81-fd60-43eb-872f-f0860aa292e1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:01.004793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 54/110] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:01.006419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74616-31c4-48eb-b086-58174f41d244 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.006744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74616-31c4-48eb-b086-58174f41d244 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.007509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff74616-31c4-48eb-b086-58174f41d244 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.009205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 55/111] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:01.009966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74616-31c4-48eb-b086-58174f41d244 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.106799 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f9f91-6d30-4629-97ad-5dca7cf790dd None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.127389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff74616-31c4-48eb-b086-58174f41d244 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.141785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490b62d-01d0-4fc1-94ba-f3cde44a8593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.142896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490b62d-01d0-4fc1-94ba-f3cde44a8593 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.143375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490b62d-01d0-4fc1-94ba-f3cde44a8593 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.143879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490b62d-01d0-4fc1-94ba-f3cde44a8593 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.154445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490b62d-01d0-4fc1-94ba-f3cde44a8593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:01.161825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610cea3-1a35-4791-af57-5100f53bce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.162533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610cea3-1a35-4791-af57-5100f53bce48 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.162820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610cea3-1a35-4791-af57-5100f53bce48 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.163125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610cea3-1a35-4791-af57-5100f53bce48 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9490b62d-01d0-4fc1-94ba-f3cde44a8593 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:01.163658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:01.164468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:01.165227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:01.165793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610cea3-1a35-4791-af57-5100f53bce48 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:01.165793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610cea3-1a35-4791-af57-5100f53bce48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:01.165793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610cea3-1a35-4791-af57-5100f53bce48 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:01.168067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 57/112] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:55:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:01.169141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490b62d-01d0-4fc1-94ba-f3cde44a8593 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.175740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 56/113] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:01.181461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089ceff-cd60-426d-9ac7-d0c799ec27f7 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.181924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089ceff-cd60-426d-9ac7-d0c799ec27f7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.182387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089ceff-cd60-426d-9ac7-d0c799ec27f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.199925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c089ceff-cd60-426d-9ac7-d0c799ec27f7 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:01.201586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c089ceff-cd60-426d-9ac7-d0c799ec27f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:01.272206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490b62d-01d0-4fc1-94ba-f3cde44a8593 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.274987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 57/114] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:01.276143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089ceff-cd60-426d-9ac7-d0c799ec27f7 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.328554 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f876-c6cd-4756-b6c8-b2b295a30ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.329426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f876-c6cd-4756-b6c8-b2b295a30ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.329709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f876-c6cd-4756-b6c8-b2b295a30ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.329985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f876-c6cd-4756-b6c8-b2b295a30ef8 None admin] PATH_INFO: `/v3/users/d4261f09bd3e4098acde3ccdf5841591` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.332036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7f876-c6cd-4756-b6c8-b2b295a30ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=d4261f09bd3e4098acde3ccdf5841591)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:01.333475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7f876-c6cd-4756-b6c8-b2b295a30ef8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:01.335709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 58/115] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/users/d4261f09bd3e4098acde3ccdf5841591 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:01.336691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f876-c6cd-4756-b6c8-b2b295a30ef8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.379861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089ceff-cd60-426d-9ac7-d0c799ec27f7 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.416455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd340200-9ed3-46c9-a8f6-b5f124c0c772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.417484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340200-9ed3-46c9-a8f6-b5f124c0c772 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.417918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340200-9ed3-46c9-a8f6-b5f124c0c772 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.418372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340200-9ed3-46c9-a8f6-b5f124c0c772 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.419351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd340200-9ed3-46c9-a8f6-b5f124c0c772 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:01.419818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd340200-9ed3-46c9-a8f6-b5f124c0c772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:01.421347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd340200-9ed3-46c9-a8f6-b5f124c0c772 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:01.429531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 58/116] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:01.430527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd340200-9ed3-46c9-a8f6-b5f124c0c772 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.441803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f876-c6cd-4756-b6c8-b2b295a30ef8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.476781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aa0a3-440c-4c3c-932f-912506fbfc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.477705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa0a3-440c-4c3c-932f-912506fbfc0c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.477936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa0a3-440c-4c3c-932f-912506fbfc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.478246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa0a3-440c-4c3c-932f-912506fbfc0c None admin] PATH_INFO: `/v3/users/c9c8ee24af83476cb33c836e60aba951` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.493082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aa0a3-440c-4c3c-932f-912506fbfc0c None admin] RBAC: Authorizing `identity:get_user(user_id=c9c8ee24af83476cb33c836e60aba951)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:01.494596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aa0a3-440c-4c3c-932f-912506fbfc0c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:01.496283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 59/117] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/users/c9c8ee24af83476cb33c836e60aba951 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:01.498975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aa0a3-440c-4c3c-932f-912506fbfc0c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.529352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd340200-9ed3-46c9-a8f6-b5f124c0c772 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.562736 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200dc2-2522-4600-8987-110b4eced8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.563554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200dc2-2522-4600-8987-110b4eced8ae None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.563845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200dc2-2522-4600-8987-110b4eced8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.564138 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200dc2-2522-4600-8987-110b4eced8ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.575296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6200dc2-2522-4600-8987-110b4eced8ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-b6200dc2-2522-4600-8987-110b4eced8ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:01.584383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:01.585494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 59/118] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:01.591629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260973f-9be3-44c9-88a4-c6ce7af13dd3 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.592326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260973f-9be3-44c9-88a4-c6ce7af13dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.592326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260973f-9be3-44c9-88a4-c6ce7af13dd3 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.592326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 60/119] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:01.592326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260973f-9be3-44c9-88a4-c6ce7af13dd3 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.605876 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aa0a3-440c-4c3c-932f-912506fbfc0c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.640304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467716d-4e7d-426d-adb1-7b010816615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.641169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467716d-4e7d-426d-adb1-7b010816615d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.641454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467716d-4e7d-426d-adb1-7b010816615d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.641726 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467716d-4e7d-426d-adb1-7b010816615d None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.642938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467716d-4e7d-426d-adb1-7b010816615d None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:01.644418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467716d-4e7d-426d-adb1-7b010816615d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:01.646180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 60/120] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:01.646944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467716d-4e7d-426d-adb1-7b010816615d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.697803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260973f-9be3-44c9-88a4-c6ce7af13dd3 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.730676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defd5ff-ba72-48ef-836c-fb937c23fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.731594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd5ff-ba72-48ef-836c-fb937c23fe81 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.731876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd5ff-ba72-48ef-836c-fb937c23fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.732149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd5ff-ba72-48ef-836c-fb937c23fe81 None admin] PATH_INFO: `/v3/users/efb24a53849544a0bc7346ef2b1d8c20` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.733326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defd5ff-ba72-48ef-836c-fb937c23fe81 None admin] RBAC: Authorizing `identity:get_user(user_id=efb24a53849544a0bc7346ef2b1d8c20)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:01.734819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defd5ff-ba72-48ef-836c-fb937c23fe81 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:01.736511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 61/121] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/users/efb24a53849544a0bc7346ef2b1d8c20 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:01.737269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defd5ff-ba72-48ef-836c-fb937c23fe81 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.744775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467716d-4e7d-426d-adb1-7b010816615d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.778699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d26af-2965-43f3-8d67-c31d20cd5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.779415 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d26af-2965-43f3-8d67-c31d20cd5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.779645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d26af-2965-43f3-8d67-c31d20cd5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.779926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d26af-2965-43f3-8d67-c31d20cd5dd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.844011 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defd5ff-ba72-48ef-836c-fb937c23fe81 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:01.845227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d26af-2965-43f3-8d67-c31d20cd5dd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:01.847009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d26af-2965-43f3-8d67-c31d20cd5dd1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:01.876159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05503c81-0ad6-41f4-97ea-a63a5b662ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:01.876979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05503c81-0ad6-41f4-97ea-a63a5b662ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.878532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05503c81-0ad6-41f4-97ea-a63a5b662ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.878873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05503c81-0ad6-41f4-97ea-a63a5b662ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.879629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05503c81-0ad6-41f4-97ea-a63a5b662ae0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:01.879939 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05503c81-0ad6-41f4-97ea-a63a5b662ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:01.881324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05503c81-0ad6-41f4-97ea-a63a5b662ae0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:01.893386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 62/122] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:01.893386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d0da0-8090-43a1-9e97-32fb1f77204a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:01.893386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d0da0-8090-43a1-9e97-32fb1f77204a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:01.893386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d0da0-8090-43a1-9e97-32fb1f77204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:01.907804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-771d0da0-8090-43a1-9e97-32fb1f77204a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:01.909018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-771d0da0-8090-43a1-9e97-32fb1f77204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:01.949363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 61/123] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:01.950557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d26af-2965-43f3-8d67-c31d20cd5dd1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:01.977470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 63/124] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:01.978344 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d0da0-8090-43a1-9e97-32fb1f77204a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:02.078739 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d26af-2965-43f3-8d67-c31d20cd5dd1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:02.119743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d0da0-8090-43a1-9e97-32fb1f77204a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:02.121592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0761c-2d5b-440c-8fd5-f7d3b94f3588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:02.123289 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0761c-2d5b-440c-8fd5-f7d3b94f3588 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:02.123495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0761c-2d5b-440c-8fd5-f7d3b94f3588 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:02.123772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0761c-2d5b-440c-8fd5-f7d3b94f3588 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71/users/d4261f09bd3e4098acde3ccdf5841591/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:02.126527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0761c-2d5b-440c-8fd5-f7d3b94f3588 None admin] RBAC: Authorizing `identity:create_grant(project_id=db8112f1b83d4722a9c6776f739c6c71, user_id=d4261f09bd3e4098acde3ccdf5841591, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:02.128623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0761c-2d5b-440c-8fd5-f7d3b94f3588 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:02.156884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf843e8-344f-4c95-8ec1-eb64c3e3084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:02.157746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf843e8-344f-4c95-8ec1-eb64c3e3084b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:02.158037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf843e8-344f-4c95-8ec1-eb64c3e3084b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:02.158345 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf843e8-344f-4c95-8ec1-eb64c3e3084b None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:02.160163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf843e8-344f-4c95-8ec1-eb64c3e3084b None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:02.161675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf843e8-344f-4c95-8ec1-eb64c3e3084b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:02.163470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 64/125] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:01 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:02.168876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf843e8-344f-4c95-8ec1-eb64c3e3084b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:02.222339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 62/126] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:55:01 2022] PUT /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71/users/d4261f09bd3e4098acde3ccdf5841591/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:55:02.222339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0761c-2d5b-440c-8fd5-f7d3b94f3588 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:02.335795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf843e8-344f-4c95-8ec1-eb64c3e3084b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:02.370035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0761c-2d5b-440c-8fd5-f7d3b94f3588 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:02.382021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7277e-2ae9-44ff-9ffa-6e22ef7f013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:02.382971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7277e-2ae9-44ff-9ffa-6e22ef7f013e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:02.383257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7277e-2ae9-44ff-9ffa-6e22ef7f013e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:02.383542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7277e-2ae9-44ff-9ffa-6e22ef7f013e None admin] PATH_INFO: `/v3/users/d4261f09bd3e4098acde3ccdf5841591` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:02.385005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7277e-2ae9-44ff-9ffa-6e22ef7f013e None admin] RBAC: Authorizing `identity:get_user(user_id=d4261f09bd3e4098acde3ccdf5841591)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:02.386740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7277e-2ae9-44ff-9ffa-6e22ef7f013e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:02.388489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 65/127] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:02 2022] GET /identity/v3/users/d4261f09bd3e4098acde3ccdf5841591 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:02.389277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7277e-2ae9-44ff-9ffa-6e22ef7f013e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:02.406541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d1d8-cb28-4ab2-b784-128319e50e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:02.407408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d1d8-cb28-4ab2-b784-128319e50e21 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:02.407690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d1d8-cb28-4ab2-b784-128319e50e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:02.407964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d1d8-cb28-4ab2-b784-128319e50e21 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:02.409789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449d1d8-cb28-4ab2-b784-128319e50e21 None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:02.411373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449d1d8-cb28-4ab2-b784-128319e50e21 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:02.413265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 63/128] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:02 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:02.414027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d1d8-cb28-4ab2-b784-128319e50e21 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:02.513073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7277e-2ae9-44ff-9ffa-6e22ef7f013e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:02.543500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d1d8-cb28-4ab2-b784-128319e50e21 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:02.553812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2241b-c494-4c89-98a4-0eca2fe29304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:02.555029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2241b-c494-4c89-98a4-0eca2fe29304 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:02.555321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2241b-c494-4c89-98a4-0eca2fe29304 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:02.555603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2241b-c494-4c89-98a4-0eca2fe29304 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:02.568892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2241b-c494-4c89-98a4-0eca2fe29304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-09a2241b-c494-4c89-98a4-0eca2fe29304 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:02.576487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:02.577433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 66/129] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:02.578858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2241b-c494-4c89-98a4-0eca2fe29304 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:02.596535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c113751-bf2f-4ac8-aa8e-a7cd26d6b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:02.599042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c113751-bf2f-4ac8-aa8e-a7cd26d6b6ba None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:02.599554 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c113751-bf2f-4ac8-aa8e-a7cd26d6b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:02.600197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c113751-bf2f-4ac8-aa8e-a7cd26d6b6ba None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71/users/efb24a53849544a0bc7346ef2b1d8c20/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:02.602811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c113751-bf2f-4ac8-aa8e-a7cd26d6b6ba None admin] RBAC: Authorizing `identity:create_grant(project_id=db8112f1b83d4722a9c6776f739c6c71, user_id=efb24a53849544a0bc7346ef2b1d8c20, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:02.605334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c113751-bf2f-4ac8-aa8e-a7cd26d6b6ba None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:02.681451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2241b-c494-4c89-98a4-0eca2fe29304 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:02.705932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 64/130] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:55:02 2022] PUT /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71/users/efb24a53849544a0bc7346ef2b1d8c20/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:55:02.713026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c113751-bf2f-4ac8-aa8e-a7cd26d6b6ba None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:02.740948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f934d7-d05e-48a4-adbc-a3221978ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:02.744491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f934d7-d05e-48a4-adbc-a3221978ca1e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:02.745196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f934d7-d05e-48a4-adbc-a3221978ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:02.746263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f934d7-d05e-48a4-adbc-a3221978ca1e None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:02.750735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f934d7-d05e-48a4-adbc-a3221978ca1e None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:02.754904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f934d7-d05e-48a4-adbc-a3221978ca1e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:02.759029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 67/131] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:02 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:02.761804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f934d7-d05e-48a4-adbc-a3221978ca1e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:02.927495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c113751-bf2f-4ac8-aa8e-a7cd26d6b6ba None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:02.928809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f934d7-d05e-48a4-adbc-a3221978ca1e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:02.986685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8329b-5ebc-4dd0-91fa-e0066e5c07c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:02.986913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c8a1-7b41-431c-b0ff-ed3702568292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:02.987993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8329b-5ebc-4dd0-91fa-e0066e5c07c4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:02.988264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c8a1-7b41-431c-b0ff-ed3702568292 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:02.988393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8329b-5ebc-4dd0-91fa-e0066e5c07c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:02.988725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c8a1-7b41-431c-b0ff-ed3702568292 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:02.988837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8329b-5ebc-4dd0-91fa-e0066e5c07c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:02.989173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c8a1-7b41-431c-b0ff-ed3702568292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:02.989875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8329b-5ebc-4dd0-91fa-e0066e5c07c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:02.990279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8c8a1-7b41-431c-b0ff-ed3702568292 None admin] RBAC: Adding query filter params (role.id=f176776959444eaa8bec7f749a9a1687, scope.project.id=db8112f1b83d4722a9c6776f739c6c71, user.id=c9c8ee24af83476cb33c836e60aba951) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:02.990389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8329b-5ebc-4dd0-91fa-e0066e5c07c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:02.990760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8c8a1-7b41-431c-b0ff-ed3702568292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:02.992021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8329b-5ebc-4dd0-91fa-e0066e5c07c4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:02.992440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8c8a1-7b41-431c-b0ff-ed3702568292 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:02.999916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 65/132] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:02 2022] GET /identity/v3/role_assignments?user.id=c9c8ee24af83476cb33c836e60aba951&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=f176776959444eaa8bec7f749a9a1687 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:03.000907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c8a1-7b41-431c-b0ff-ed3702568292 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:03.002671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 68/133] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:03.011661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8329b-5ebc-4dd0-91fa-e0066e5c07c4 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:03.133881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c8a1-7b41-431c-b0ff-ed3702568292 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:03.172333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea41656-5436-4f59-8db5-2ff69960ff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:03.173253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea41656-5436-4f59-8db5-2ff69960ff92 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:03.173536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea41656-5436-4f59-8db5-2ff69960ff92 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:03.173810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea41656-5436-4f59-8db5-2ff69960ff92 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71/users/d4261f09bd3e4098acde3ccdf5841591/roles/638115ca27864c64a0554c5c0913956a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:03.179068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea41656-5436-4f59-8db5-2ff69960ff92 None admin] RBAC: Authorizing `identity:create_grant(project_id=db8112f1b83d4722a9c6776f739c6c71, user_id=d4261f09bd3e4098acde3ccdf5841591, role_id=638115ca27864c64a0554c5c0913956a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:03.180462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea41656-5436-4f59-8db5-2ff69960ff92 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:03.214771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8329b-5ebc-4dd0-91fa-e0066e5c07c4 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:03.272932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 66/134] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:55:02 2022] PUT /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71/users/d4261f09bd3e4098acde3ccdf5841591/roles/638115ca27864c64a0554c5c0913956a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:55:03.282624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27d655-6165-4f11-9fa2-0377ef7bb0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:03.283532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d655-6165-4f11-9fa2-0377ef7bb0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:03.283817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d655-6165-4f11-9fa2-0377ef7bb0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:03.284095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d655-6165-4f11-9fa2-0377ef7bb0a2 None admin] PATH_INFO: `/v3/users/d4261f09bd3e4098acde3ccdf5841591` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:03.285913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27d655-6165-4f11-9fa2-0377ef7bb0a2 None admin] RBAC: Authorizing `identity:get_user(user_id=d4261f09bd3e4098acde3ccdf5841591)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:03.287417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27d655-6165-4f11-9fa2-0377ef7bb0a2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:03.289085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 69/135] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:03 2022] GET /identity/v3/users/d4261f09bd3e4098acde3ccdf5841591 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:03.295014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea41656-5436-4f59-8db5-2ff69960ff92 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:03.314687 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb3f56-62a0-4a40-85ec-82b46d60b22f None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:03.314977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb3f56-62a0-4a40-85ec-82b46d60b22f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:03.315257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb3f56-62a0-4a40-85ec-82b46d60b22f None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:03.316675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 70/136] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:03.344325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4114d-d614-4258-95b3-194b6e3b705d None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:03.344645 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4114d-d614-4258-95b3-194b6e3b705d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:03.344931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4114d-d614-4258-95b3-194b6e3b705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:03.375667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-96f4114d-d614-4258-95b3-194b6e3b705d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:03.376881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-96f4114d-d614-4258-95b3-194b6e3b705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:03.412736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea41656-5436-4f59-8db5-2ff69960ff92 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:03.457437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbb26a-6166-4a26-812e-ad8a57e6cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:03.458257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbb26a-6166-4a26-812e-ad8a57e6cd3e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:03.458542 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbb26a-6166-4a26-812e-ad8a57e6cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:03.458817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbb26a-6166-4a26-812e-ad8a57e6cd3e None admin] PATH_INFO: `/v3/projects/49b98da09136430a933535cf6fb4dfa9` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:03.462650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbb26a-6166-4a26-812e-ad8a57e6cd3e None admin] RBAC: Authorizing `identity:get_project(project_id=49b98da09136430a933535cf6fb4dfa9)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:03.464140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbb26a-6166-4a26-812e-ad8a57e6cd3e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:03.465923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 67/137] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:03 2022] GET /identity/v3/projects/49b98da09136430a933535cf6fb4dfa9 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:03.472166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbb26a-6166-4a26-812e-ad8a57e6cd3e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:03.496416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 71/138] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:03.525304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4114d-d614-4258-95b3-194b6e3b705d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:03.620425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbb26a-6166-4a26-812e-ad8a57e6cd3e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:03.663348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58399290-296f-4a18-a22d-fa67bf1915ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:03.664357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58399290-296f-4a18-a22d-fa67bf1915ba None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:03.664648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58399290-296f-4a18-a22d-fa67bf1915ba None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:03.664929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58399290-296f-4a18-a22d-fa67bf1915ba None admin] PATH_INFO: `/v3/projects/49b98da09136430a933535cf6fb4dfa9/users/d4261f09bd3e4098acde3ccdf5841591/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:03.668671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58399290-296f-4a18-a22d-fa67bf1915ba None admin] RBAC: Authorizing `identity:create_grant(project_id=49b98da09136430a933535cf6fb4dfa9, user_id=d4261f09bd3e4098acde3ccdf5841591, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:03.670221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58399290-296f-4a18-a22d-fa67bf1915ba None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:03.716884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4114d-d614-4258-95b3-194b6e3b705d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:03.747445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 68/139] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:55:03 2022] PUT /identity/v3/projects/49b98da09136430a933535cf6fb4dfa9/users/d4261f09bd3e4098acde3ccdf5841591/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:55:03.763831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de575471-dda2-4e0b-8762-b296fb342dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:03.764699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575471-dda2-4e0b-8762-b296fb342dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:03.764982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575471-dda2-4e0b-8762-b296fb342dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:03.765301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575471-dda2-4e0b-8762-b296fb342dd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:03.766646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de575471-dda2-4e0b-8762-b296fb342dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:03.768477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de575471-dda2-4e0b-8762-b296fb342dd9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:03.770456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 72/140] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:03.776554 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58399290-296f-4a18-a22d-fa67bf1915ba None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:03.886939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58399290-296f-4a18-a22d-fa67bf1915ba None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:03.922551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c3c85-f51f-4f17-bf52-dd38353cd180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:03.923252 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c3c85-f51f-4f17-bf52-dd38353cd180 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:03.923536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c3c85-f51f-4f17-bf52-dd38353cd180 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:03.923813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c3c85-f51f-4f17-bf52-dd38353cd180 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:03.924545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c3c85-f51f-4f17-bf52-dd38353cd180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:03.926603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c3c85-f51f-4f17-bf52-dd38353cd180 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:04.044658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 69/141] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:03 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:05.089416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afd4a-0b99-404b-955e-cb72f02c00dc None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:05.089889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afd4a-0b99-404b-955e-cb72f02c00dc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:05.089963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afd4a-0b99-404b-955e-cb72f02c00dc None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:05.091527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 73/142] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:05.097061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ffce-56df-4020-9f21-1b85c2456c89 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:05.097501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ffce-56df-4020-9f21-1b85c2456c89 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:05.097706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ffce-56df-4020-9f21-1b85c2456c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:05.119083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3f42ffce-56df-4020-9f21-1b85c2456c89 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:05.120294 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3f42ffce-56df-4020-9f21-1b85c2456c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:05.216006 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 70/143] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:05.251457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119afd4a-0b99-404b-955e-cb72f02c00dc None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:05.367335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119afd4a-0b99-404b-955e-cb72f02c00dc None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:05.402040 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2775c-bcd1-4328-98ed-da22f4e0dbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:05.402864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2775c-bcd1-4328-98ed-da22f4e0dbaf None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:05.403147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2775c-bcd1-4328-98ed-da22f4e0dbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:05.403420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2775c-bcd1-4328-98ed-da22f4e0dbaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:05.417880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2775c-bcd1-4328-98ed-da22f4e0dbaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-5cf2775c-bcd1-4328-98ed-da22f4e0dbaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:05.426169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:05.427015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:05.427786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 74/144] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:05.434760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ffce-56df-4020-9f21-1b85c2456c89 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:05.546677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ffce-56df-4020-9f21-1b85c2456c89 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:05.585857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f137598-b9d7-4e69-ae49-b69b400b22c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:05.586575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137598-b9d7-4e69-ae49-b69b400b22c4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:05.586860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137598-b9d7-4e69-ae49-b69b400b22c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:05.587134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137598-b9d7-4e69-ae49-b69b400b22c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:05.587890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f137598-b9d7-4e69-ae49-b69b400b22c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:05.588198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f137598-b9d7-4e69-ae49-b69b400b22c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:05.589598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f137598-b9d7-4e69-ae49-b69b400b22c4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:05.599173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 71/145] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:05.605629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2775c-bcd1-4328-98ed-da22f4e0dbaf None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:05.709909 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2775c-bcd1-4328-98ed-da22f4e0dbaf None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:05.751784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc56a54-36d3-436c-9511-9c183903d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:05.752663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc56a54-36d3-436c-9511-9c183903d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:05.752973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc56a54-36d3-436c-9511-9c183903d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:05.753245 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc56a54-36d3-436c-9511-9c183903d0c7 None admin] PATH_INFO: `/v3/users/d4261f09bd3e4098acde3ccdf5841591` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:05.754567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc56a54-36d3-436c-9511-9c183903d0c7 None admin] RBAC: Authorizing `identity:get_user(user_id=d4261f09bd3e4098acde3ccdf5841591)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:05.756165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc56a54-36d3-436c-9511-9c183903d0c7 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:05.757886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 75/146] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:05 2022] GET /identity/v3/users/d4261f09bd3e4098acde3ccdf5841591 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:05.763497 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f137598-b9d7-4e69-ae49-b69b400b22c4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:05.872619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f137598-b9d7-4e69-ae49-b69b400b22c4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:05.887692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df4062-dda6-4fda-ab04-affaf12c4f04 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:05.887987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df4062-dda6-4fda-ab04-affaf12c4f04 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:05.888254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df4062-dda6-4fda-ab04-affaf12c4f04 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:05.889629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 76/147] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:05.895505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbe86d-2753-4c1c-9a49-c50551eac8aa None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:05.895794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbe86d-2753-4c1c-9a49-c50551eac8aa None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:05.896073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbe86d-2753-4c1c-9a49-c50551eac8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:05.920275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2ebbe86d-2753-4c1c-9a49-c50551eac8aa None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:05.921461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2ebbe86d-2753-4c1c-9a49-c50551eac8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:05.938844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83ccab-6562-4174-9d7f-37d3b53551ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:05.939412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ccab-6562-4174-9d7f-37d3b53551ae None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:05.939695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ccab-6562-4174-9d7f-37d3b53551ae None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:05.939971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ccab-6562-4174-9d7f-37d3b53551ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:06.084038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83ccab-6562-4174-9d7f-37d3b53551ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:06.085791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83ccab-6562-4174-9d7f-37d3b53551ae None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:06.107268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 77/148] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:06.219768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 72/149] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:06.223916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbe86d-2753-4c1c-9a49-c50551eac8aa None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:06.231711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83ccab-6562-4174-9d7f-37d3b53551ae None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:06.370178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83ccab-6562-4174-9d7f-37d3b53551ae None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:06.392303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbe86d-2753-4c1c-9a49-c50551eac8aa None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:06.418085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45eefd-7521-4558-83e2-a53be32e5ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:06.418085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45eefd-7521-4558-83e2-a53be32e5ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:06.418085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45eefd-7521-4558-83e2-a53be32e5ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:06.418085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45eefd-7521-4558-83e2-a53be32e5ad2 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:06.419127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45eefd-7521-4558-83e2-a53be32e5ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:06.420592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45eefd-7521-4558-83e2-a53be32e5ad2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:06.422983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 73/150] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:06 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:06.443626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45eefd-7521-4558-83e2-a53be32e5ad2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:06.448375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bffe0-ed81-4dd2-908b-871b6a99a3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:06.449440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bffe0-ed81-4dd2-908b-871b6a99a3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:06.449924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bffe0-ed81-4dd2-908b-871b6a99a3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:06.450419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bffe0-ed81-4dd2-908b-871b6a99a3e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:06.471156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bffe0-ed81-4dd2-908b-871b6a99a3e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-473bffe0-ed81-4dd2-908b-871b6a99a3e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:06.479194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:06.480067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:06.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:06.488033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 78/151] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:55:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:06.493849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bffe0-ed81-4dd2-908b-871b6a99a3e8 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:06.581083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45eefd-7521-4558-83e2-a53be32e5ad2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:06.611869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bffe0-ed81-4dd2-908b-871b6a99a3e8 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:06.635836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e74d8-bfd1-46bd-b0e3-52b28dbac506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:06.636667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e74d8-bfd1-46bd-b0e3-52b28dbac506 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:06.636667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e74d8-bfd1-46bd-b0e3-52b28dbac506 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:06.636963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e74d8-bfd1-46bd-b0e3-52b28dbac506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:06.637825 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e74d8-bfd1-46bd-b0e3-52b28dbac506 None admin] RBAC: Adding query filter params (role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=db8112f1b83d4722a9c6776f739c6c71, user.id=d4261f09bd3e4098acde3ccdf5841591) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:06.638120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e74d8-bfd1-46bd-b0e3-52b28dbac506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:06.639580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e74d8-bfd1-46bd-b0e3-52b28dbac506 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:06.645930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 74/152] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:06 2022] GET /identity/v3/role_assignments?user.id=d4261f09bd3e4098acde3ccdf5841591&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:06.654359 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc2f4d-6dce-4fdf-b0c0-4b888805794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:06.655326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2f4d-6dce-4fdf-b0c0-4b888805794d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:06.655810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2f4d-6dce-4fdf-b0c0-4b888805794d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:06.656282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc2f4d-6dce-4fdf-b0c0-4b888805794d None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:06.657240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc2f4d-6dce-4fdf-b0c0-4b888805794d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:06.657746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc2f4d-6dce-4fdf-b0c0-4b888805794d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:06.659425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc2f4d-6dce-4fdf-b0c0-4b888805794d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:06.673130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 79/153] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:06.679112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e74d8-bfd1-46bd-b0e3-52b28dbac506 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:06.753886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910620b-bc6a-4ed3-a909-5bdb1fbea56a None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:06.754675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910620b-bc6a-4ed3-a909-5bdb1fbea56a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:06.755177 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910620b-bc6a-4ed3-a909-5bdb1fbea56a None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:06.756779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 80/154] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:06.762408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5729-1e8d-49fd-b82d-defee84d85c4 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:06.762994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5729-1e8d-49fd-b82d-defee84d85c4 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:06.763464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f5729-1e8d-49fd-b82d-defee84d85c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:06.795160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-da6f5729-1e8d-49fd-b82d-defee84d85c4 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:06.796739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-da6f5729-1e8d-49fd-b82d-defee84d85c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:06.814250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e74d8-bfd1-46bd-b0e3-52b28dbac506 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:06.864036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a88bc-9f28-4873-81ce-ab27756a132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:06.864935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a88bc-9f28-4873-81ce-ab27756a132a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:06.865216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a88bc-9f28-4873-81ce-ab27756a132a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:06.865491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a88bc-9f28-4873-81ce-ab27756a132a None admin] PATH_INFO: `/v3/users/efb24a53849544a0bc7346ef2b1d8c20` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:06.871078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a88bc-9f28-4873-81ce-ab27756a132a None admin] RBAC: Authorizing `identity:get_user(user_id=efb24a53849544a0bc7346ef2b1d8c20)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:06.872593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a88bc-9f28-4873-81ce-ab27756a132a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:06.874753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 75/155] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:06 2022] GET /identity/v3/users/efb24a53849544a0bc7346ef2b1d8c20 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:06.894914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a88bc-9f28-4873-81ce-ab27756a132a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:06.902757 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 81/156] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 16 14:55:06.944192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5729-1e8d-49fd-b82d-defee84d85c4 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:07.011445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a88bc-9f28-4873-81ce-ab27756a132a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:07.050798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906f985-8d8e-4213-b1b5-b50b74ade5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:07.051458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906f985-8d8e-4213-b1b5-b50b74ade5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:07.051753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906f985-8d8e-4213-b1b5-b50b74ade5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:07.052018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906f985-8d8e-4213-b1b5-b50b74ade5d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:07.128964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f5729-1e8d-49fd-b82d-defee84d85c4 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:07.140107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906f985-8d8e-4213-b1b5-b50b74ade5d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:07.142907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906f985-8d8e-4213-b1b5-b50b74ade5d2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:07.177844 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4de84-112a-464c-8ba8-d12545ba0fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:07.178639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4de84-112a-464c-8ba8-d12545ba0fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:07.178924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4de84-112a-464c-8ba8-d12545ba0fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:07.179199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4de84-112a-464c-8ba8-d12545ba0fd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:07.195694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4de84-112a-464c-8ba8-d12545ba0fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-d6f4de84-112a-464c-8ba8-d12545ba0fd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:07.205701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:07.207220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:07.208582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 82/157] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:07.213729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4de84-112a-464c-8ba8-d12545ba0fd0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:07.244454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 76/158] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:07.249530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906f985-8d8e-4213-b1b5-b50b74ade5d2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:07.326481 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4de84-112a-464c-8ba8-d12545ba0fd0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:07.363186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb9696-8096-4bcd-b1f1-2f25fedfc477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:07.363863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb9696-8096-4bcd-b1f1-2f25fedfc477 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:07.364145 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb9696-8096-4bcd-b1f1-2f25fedfc477 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:07.364419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb9696-8096-4bcd-b1f1-2f25fedfc477 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:07.365172 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb9696-8096-4bcd-b1f1-2f25fedfc477 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:07.365476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb9696-8096-4bcd-b1f1-2f25fedfc477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:07.366708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906f985-8d8e-4213-b1b5-b50b74ade5d2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:07.367109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb9696-8096-4bcd-b1f1-2f25fedfc477 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:07.375798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 83/159] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:07.383734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb9696-8096-4bcd-b1f1-2f25fedfc477 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:07.415507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d7c27-3ef7-45a3-aa26-e900cb80d116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:07.416377 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7c27-3ef7-45a3-aa26-e900cb80d116 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:07.418961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7c27-3ef7-45a3-aa26-e900cb80d116 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:07.419246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7c27-3ef7-45a3-aa26-e900cb80d116 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:07.421563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d7c27-3ef7-45a3-aa26-e900cb80d116 None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:07.423056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d7c27-3ef7-45a3-aa26-e900cb80d116 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:07.429332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 77/160] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:07 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:07.430574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b0552-4f8f-40da-a27c-1248a3f34e85 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:07.430857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b0552-4f8f-40da-a27c-1248a3f34e85 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:07.431129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b0552-4f8f-40da-a27c-1248a3f34e85 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:07.436767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 78/161] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:07.437575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b0552-4f8f-40da-a27c-1248a3f34e85 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:07.575200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b0552-4f8f-40da-a27c-1248a3f34e85 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:07.631935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb9696-8096-4bcd-b1f1-2f25fedfc477 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:07.662761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636741e9-78ad-4905-bbf0-731c222739e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:07.663755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636741e9-78ad-4905-bbf0-731c222739e8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:07.664243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636741e9-78ad-4905-bbf0-731c222739e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:07.664717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636741e9-78ad-4905-bbf0-731c222739e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:07.665745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636741e9-78ad-4905-bbf0-731c222739e8 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=db8112f1b83d4722a9c6776f739c6c71, user.id=efb24a53849544a0bc7346ef2b1d8c20) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:07.666460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636741e9-78ad-4905-bbf0-731c222739e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:07.668111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636741e9-78ad-4905-bbf0-731c222739e8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:07.674303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 79/162] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:07 2022] GET /identity/v3/role_assignments?user.id=efb24a53849544a0bc7346ef2b1d8c20&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=042169a166e14a80beac826291ceaf73 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:07.675800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0f42-1e19-49ac-b79e-8a0eb44e50f2 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:07.676292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0f42-1e19-49ac-b79e-8a0eb44e50f2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:07.676785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0f42-1e19-49ac-b79e-8a0eb44e50f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:07.711484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3edf0f42-1e19-49ac-b79e-8a0eb44e50f2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:07.713021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3edf0f42-1e19-49ac-b79e-8a0eb44e50f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:07.722810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfb679-4c22-45b6-9020-b0c38efb0dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:07.723712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfb679-4c22-45b6-9020-b0c38efb0dce None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:07.723993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfb679-4c22-45b6-9020-b0c38efb0dce None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:07.724264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfb679-4c22-45b6-9020-b0c38efb0dce None admin] PATH_INFO: `/v3/users/d4261f09bd3e4098acde3ccdf5841591` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:07.730096 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfb679-4c22-45b6-9020-b0c38efb0dce None admin] RBAC: Authorizing `identity:get_user(user_id=d4261f09bd3e4098acde3ccdf5841591)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:07.730096 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfb679-4c22-45b6-9020-b0c38efb0dce None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:07.730096 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 84/163] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:07 2022] GET /identity/v3/users/d4261f09bd3e4098acde3ccdf5841591 => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:07.734562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfb679-4c22-45b6-9020-b0c38efb0dce None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:07.865035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 80/164] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:07.915801 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf0f42-1e19-49ac-b79e-8a0eb44e50f2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:07.942788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfb679-4c22-45b6-9020-b0c38efb0dce None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:07.995712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57916f6a-0a94-464b-9a28-9e4fc538943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:07.996362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57916f6a-0a94-464b-9a28-9e4fc538943e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:07.996967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57916f6a-0a94-464b-9a28-9e4fc538943e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:07.996967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57916f6a-0a94-464b-9a28-9e4fc538943e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.104464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf0f42-1e19-49ac-b79e-8a0eb44e50f2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:08.104652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57916f6a-0a94-464b-9a28-9e4fc538943e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:08.114083 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57916f6a-0a94-464b-9a28-9e4fc538943e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:08.164016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4c3b9-8a22-4169-a39e-5ed20e8bee58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:08.165188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4c3b9-8a22-4169-a39e-5ed20e8bee58 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:08.165693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4c3b9-8a22-4169-a39e-5ed20e8bee58 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:08.166196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4c3b9-8a22-4169-a39e-5ed20e8bee58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.188949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4c3b9-8a22-4169-a39e-5ed20e8bee58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-79e4c3b9-8a22-4169-a39e-5ed20e8bee58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:08.201234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:08.202196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:08.202994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:08.205545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 81/165] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:08.212200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4c3b9-8a22-4169-a39e-5ed20e8bee58 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:08.240317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 85/166] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:08.245984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57916f6a-0a94-464b-9a28-9e4fc538943e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:08.346783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4c3b9-8a22-4169-a39e-5ed20e8bee58 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:08.382749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57916f6a-0a94-464b-9a28-9e4fc538943e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:08.394776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f664be5-396f-4974-8379-47e0381d4bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:08.395812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f664be5-396f-4974-8379-47e0381d4bfe None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:08.396303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f664be5-396f-4974-8379-47e0381d4bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:08.396776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f664be5-396f-4974-8379-47e0381d4bfe None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.397740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f664be5-396f-4974-8379-47e0381d4bfe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:08.398451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f664be5-396f-4974-8379-47e0381d4bfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:08.400089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f664be5-396f-4974-8379-47e0381d4bfe None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:08.409016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 82/167] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:08.410600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958d480-222a-4d41-ac60-2fdb6a4043e6 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:08.411120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958d480-222a-4d41-ac60-2fdb6a4043e6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:08.411596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958d480-222a-4d41-ac60-2fdb6a4043e6 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.413077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 83/168] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:08.416260 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958d480-222a-4d41-ac60-2fdb6a4043e6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:08.423321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d8d6d-2cee-4b7e-bd7a-0fa9f323c475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:08.424392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8d6d-2cee-4b7e-bd7a-0fa9f323c475 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:08.425341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8d6d-2cee-4b7e-bd7a-0fa9f323c475 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:08.425780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d8d6d-2cee-4b7e-bd7a-0fa9f323c475 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.427170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d8d6d-2cee-4b7e-bd7a-0fa9f323c475 None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:08.429670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d8d6d-2cee-4b7e-bd7a-0fa9f323c475 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:08.431590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 86/169] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:08 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:08.432959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e165b-75e5-41de-b834-6710bdf1e27a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:08.433407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e165b-75e5-41de-b834-6710bdf1e27a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:08.433836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e165b-75e5-41de-b834-6710bdf1e27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.458571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-171e165b-75e5-41de-b834-6710bdf1e27a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:08.459764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-171e165b-75e5-41de-b834-6710bdf1e27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:08.545080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958d480-222a-4d41-ac60-2fdb6a4043e6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:08.563439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 87/170] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:08.564432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e165b-75e5-41de-b834-6710bdf1e27a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:08.590763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572207c8-cca0-4eeb-8010-807a62c7e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:08.591894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572207c8-cca0-4eeb-8010-807a62c7e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:08.592324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572207c8-cca0-4eeb-8010-807a62c7e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:08.592811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572207c8-cca0-4eeb-8010-807a62c7e6c6 None admin] PATH_INFO: `/v3/users/c9c8ee24af83476cb33c836e60aba951` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.594218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572207c8-cca0-4eeb-8010-807a62c7e6c6 None admin] RBAC: Authorizing `identity:get_user(user_id=c9c8ee24af83476cb33c836e60aba951)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:08.596001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572207c8-cca0-4eeb-8010-807a62c7e6c6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:08.598374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 84/171] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:08 2022] GET /identity/v3/users/c9c8ee24af83476cb33c836e60aba951 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:08.603798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572207c8-cca0-4eeb-8010-807a62c7e6c6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:08.668784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e165b-75e5-41de-b834-6710bdf1e27a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:08.702984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49f9c-d357-4b49-8c97-ecf7fd7e190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:08.703744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49f9c-d357-4b49-8c97-ecf7fd7e190a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:08.704250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49f9c-d357-4b49-8c97-ecf7fd7e190a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:08.704481 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d49f9c-d357-4b49-8c97-ecf7fd7e190a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.705454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d49f9c-d357-4b49-8c97-ecf7fd7e190a None admin] RBAC: Adding query filter params (role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=db8112f1b83d4722a9c6776f739c6c71, user.id=d4261f09bd3e4098acde3ccdf5841591) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:08.705853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d49f9c-d357-4b49-8c97-ecf7fd7e190a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:08.707424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d49f9c-d357-4b49-8c97-ecf7fd7e190a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:08.710776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572207c8-cca0-4eeb-8010-807a62c7e6c6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:08.714151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 88/172] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:08 2022] GET /identity/v3/role_assignments?user.id=d4261f09bd3e4098acde3ccdf5841591&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=638115ca27864c64a0554c5c0913956a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:08.715056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49f9c-d357-4b49-8c97-ecf7fd7e190a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:08.757806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178ae80-e3db-4808-9117-19f6a2dd140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:08.758965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ae80-e3db-4808-9117-19f6a2dd140d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:08.759392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ae80-e3db-4808-9117-19f6a2dd140d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:08.759833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178ae80-e3db-4808-9117-19f6a2dd140d None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.767017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178ae80-e3db-4808-9117-19f6a2dd140d None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:08.769307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178ae80-e3db-4808-9117-19f6a2dd140d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:08.771306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 85/173] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:08 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:08.777008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178ae80-e3db-4808-9117-19f6a2dd140d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:08.819930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d49f9c-d357-4b49-8c97-ecf7fd7e190a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:08.862587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54aae-3d92-4722-9b2f-26efa954d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:08.862587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54aae-3d92-4722-9b2f-26efa954d8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:08.862587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54aae-3d92-4722-9b2f-26efa954d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:08.862587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54aae-3d92-4722-9b2f-26efa954d8b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:08.867235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d54aae-3d92-4722-9b2f-26efa954d8b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-f5d54aae-3d92-4722-9b2f-26efa954d8b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:08.875101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:08.876456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:08.877430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:08.880613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 89/174] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:08.890086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54aae-3d92-4722-9b2f-26efa954d8b6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:08.972285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178ae80-e3db-4808-9117-19f6a2dd140d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:08.989729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54aae-3d92-4722-9b2f-26efa954d8b6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:09.025393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb363089-7f8f-4934-a3f1-50b359dd33e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:09.026272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb363089-7f8f-4934-a3f1-50b359dd33e2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.026658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb363089-7f8f-4934-a3f1-50b359dd33e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.027032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb363089-7f8f-4934-a3f1-50b359dd33e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.027922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb363089-7f8f-4934-a3f1-50b359dd33e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:09.028330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb363089-7f8f-4934-a3f1-50b359dd33e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:09.029852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb363089-7f8f-4934-a3f1-50b359dd33e2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:09.039887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 90/175] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:09.045638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb363089-7f8f-4934-a3f1-50b359dd33e2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:09.071796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98c36e-66f6-4705-87ed-3a2c83f97269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:09.072648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98c36e-66f6-4705-87ed-3a2c83f97269 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.072926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98c36e-66f6-4705-87ed-3a2c83f97269 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.073199 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98c36e-66f6-4705-87ed-3a2c83f97269 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71/users/c9c8ee24af83476cb33c836e60aba951/roles/f176776959444eaa8bec7f749a9a1687` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.079650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98c36e-66f6-4705-87ed-3a2c83f97269 None admin] RBAC: Authorizing `identity:create_grant(project_id=db8112f1b83d4722a9c6776f739c6c71, user_id=c9c8ee24af83476cb33c836e60aba951, role_id=f176776959444eaa8bec7f749a9a1687)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:09.082033 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98c36e-66f6-4705-87ed-3a2c83f97269 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:09.154197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb363089-7f8f-4934-a3f1-50b359dd33e2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:09.190745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4e9dc-fff0-455f-acf9-583d1c9965bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:09.191577 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e9dc-fff0-455f-acf9-583d1c9965bf None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.191687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 86/176] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:55:08 2022] PUT /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71/users/c9c8ee24af83476cb33c836e60aba951/roles/f176776959444eaa8bec7f749a9a1687 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:55:09.191859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e9dc-fff0-455f-acf9-583d1c9965bf None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.192116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e9dc-fff0-455f-acf9-583d1c9965bf None admin] PATH_INFO: `/v3/users/d4261f09bd3e4098acde3ccdf5841591` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.193338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4e9dc-fff0-455f-acf9-583d1c9965bf None admin] RBAC: Authorizing `identity:get_user(user_id=d4261f09bd3e4098acde3ccdf5841591)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:09.194859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4e9dc-fff0-455f-acf9-583d1c9965bf None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:09.196571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 91/177] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:09 2022] GET /identity/v3/users/d4261f09bd3e4098acde3ccdf5841591 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:09.202280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98c36e-66f6-4705-87ed-3a2c83f97269 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:09.274331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28263c5d-114a-48d4-8dca-02e9034881b7 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.275236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28263c5d-114a-48d4-8dca-02e9034881b7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.275693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28263c5d-114a-48d4-8dca-02e9034881b7 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.277638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 92/178] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:09.279080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3751e5c-cac0-4a88-8c56-cf1c17a2a074 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.279581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3751e5c-cac0-4a88-8c56-cf1c17a2a074 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.280030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3751e5c-cac0-4a88-8c56-cf1c17a2a074 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.281829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 93/179] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:09.287863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9ddcd-517e-48bd-a649-1a4485ea65ac None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.288440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9ddcd-517e-48bd-a649-1a4485ea65ac None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.289010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9ddcd-517e-48bd-a649-1a4485ea65ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.306390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d5a9ddcd-517e-48bd-a649-1a4485ea65ac None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:09.307955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d5a9ddcd-517e-48bd-a649-1a4485ea65ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:09.347858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98c36e-66f6-4705-87ed-3a2c83f97269 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:09.415925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf1c0e-9cfb-4725-963c-542287f715c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:09.416582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf1c0e-9cfb-4725-963c-542287f715c9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.416853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf1c0e-9cfb-4725-963c-542287f715c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.417124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf1c0e-9cfb-4725-963c-542287f715c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.417854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 94/180] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:09.419386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06408b17-d62a-47f2-a872-78627982fd91 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.426083 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06408b17-d62a-47f2-a872-78627982fd91 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.426869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06408b17-d62a-47f2-a872-78627982fd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.448700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-06408b17-d62a-47f2-a872-78627982fd91 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:09.450231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-06408b17-d62a-47f2-a872-78627982fd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:09.493237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf1c0e-9cfb-4725-963c-542287f715c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:09.494750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf1c0e-9cfb-4725-963c-542287f715c9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:09.538216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 95/181] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:09.539541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06408b17-d62a-47f2-a872-78627982fd91 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:09.610764 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 87/182] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:09.611603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf1c0e-9cfb-4725-963c-542287f715c9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:09.656502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06408b17-d62a-47f2-a872-78627982fd91 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:09.689021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3835afc-f54b-4f75-9d8e-5bfd766bf53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:09.689801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3835afc-f54b-4f75-9d8e-5bfd766bf53d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.690092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3835afc-f54b-4f75-9d8e-5bfd766bf53d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.690399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3835afc-f54b-4f75-9d8e-5bfd766bf53d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.691556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3835afc-f54b-4f75-9d8e-5bfd766bf53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:09.693015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3835afc-f54b-4f75-9d8e-5bfd766bf53d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:09.699244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 96/183] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:09.699244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271514a0-6cdc-49d7-9ae5-e223bfdd1e4d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.699244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271514a0-6cdc-49d7-9ae5-e223bfdd1e4d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.699244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271514a0-6cdc-49d7-9ae5-e223bfdd1e4d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.699244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 97/184] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:09.699244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271514a0-6cdc-49d7-9ae5-e223bfdd1e4d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:09.714101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf1c0e-9cfb-4725-963c-542287f715c9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:09.746993 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeaeba-d74d-4c8d-8fcd-a8853f5200e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:09.748069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeaeba-d74d-4c8d-8fcd-a8853f5200e5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.748519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeaeba-d74d-4c8d-8fcd-a8853f5200e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.748956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeaeba-d74d-4c8d-8fcd-a8853f5200e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.760537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeaeba-d74d-4c8d-8fcd-a8853f5200e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9ffeaeba-d74d-4c8d-8fcd-a8853f5200e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:09.771082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:09.771999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 88/185] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:55:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:09.773196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeaeba-d74d-4c8d-8fcd-a8853f5200e5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:09.803880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271514a0-6cdc-49d7-9ae5-e223bfdd1e4d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:09.837345 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78456ea5-593f-4f24-9ad8-13933f16d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:09.838231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456ea5-593f-4f24-9ad8-13933f16d943 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.838539 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456ea5-593f-4f24-9ad8-13933f16d943 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.838890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456ea5-593f-4f24-9ad8-13933f16d943 None admin] PATH_INFO: `/v3/projects/49b98da09136430a933535cf6fb4dfa9` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.840079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456ea5-593f-4f24-9ad8-13933f16d943 None admin] RBAC: Authorizing `identity:get_project(project_id=49b98da09136430a933535cf6fb4dfa9)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:09.841517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456ea5-593f-4f24-9ad8-13933f16d943 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:09.843256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 98/186] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:09 2022] GET /identity/v3/projects/49b98da09136430a933535cf6fb4dfa9 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:09.849778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49693-4823-4cb8-b01b-414b93ec6a11 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.850085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49693-4823-4cb8-b01b-414b93ec6a11 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.850358 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f49693-4823-4cb8-b01b-414b93ec6a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.866023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d2f49693-4823-4cb8-b01b-414b93ec6a11 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:09.867174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d2f49693-4823-4cb8-b01b-414b93ec6a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:09.879781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeaeba-d74d-4c8d-8fcd-a8853f5200e5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:09.913722 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba59b05-a653-48c5-80e2-82f97b883891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:09.914530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59b05-a653-48c5-80e2-82f97b883891 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:09.914886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59b05-a653-48c5-80e2-82f97b883891 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:09.915166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59b05-a653-48c5-80e2-82f97b883891 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:09.915875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba59b05-a653-48c5-80e2-82f97b883891 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:09.917315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba59b05-a653-48c5-80e2-82f97b883891 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:09.934034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 99/187] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:09.942180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49693-4823-4cb8-b01b-414b93ec6a11 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:10.033077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f49693-4823-4cb8-b01b-414b93ec6a11 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:10.036219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 89/188] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:09 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:10.043230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba59b05-a653-48c5-80e2-82f97b883891 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:10.075474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4140066-2c8c-490e-873f-8fdcf476c091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:10.076848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4140066-2c8c-490e-873f-8fdcf476c091 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:10.077370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4140066-2c8c-490e-873f-8fdcf476c091 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:10.078087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4140066-2c8c-490e-873f-8fdcf476c091 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:10.079629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4140066-2c8c-490e-873f-8fdcf476c091 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:10.080182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4140066-2c8c-490e-873f-8fdcf476c091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:10.082627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4140066-2c8c-490e-873f-8fdcf476c091 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:10.096257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 100/189] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:10.098234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4140066-2c8c-490e-873f-8fdcf476c091 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:10.175080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba59b05-a653-48c5-80e2-82f97b883891 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:10.211447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d98cf9-c694-4f85-bbbf-9c8b270070d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:10.212324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d98cf9-c694-4f85-bbbf-9c8b270070d3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:10.212434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d98cf9-c694-4f85-bbbf-9c8b270070d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:10.212649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d98cf9-c694-4f85-bbbf-9c8b270070d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:10.213536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d98cf9-c694-4f85-bbbf-9c8b270070d3 None admin] RBAC: Adding query filter params (role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=49b98da09136430a933535cf6fb4dfa9, user.id=d4261f09bd3e4098acde3ccdf5841591) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:10.213787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d98cf9-c694-4f85-bbbf-9c8b270070d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:10.215373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d98cf9-c694-4f85-bbbf-9c8b270070d3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:10.222096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 90/190] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:10 2022] GET /identity/v3/role_assignments?user.id=d4261f09bd3e4098acde3ccdf5841591&scope.project.id=49b98da09136430a933535cf6fb4dfa9&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:10.222810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4140066-2c8c-490e-873f-8fdcf476c091 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:10.223083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d98cf9-c694-4f85-bbbf-9c8b270070d3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:10.260780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2b18-6680-471b-a1d4-5094d90eb036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:10.262086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2b18-6680-471b-a1d4-5094d90eb036 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:10.262573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2b18-6680-471b-a1d4-5094d90eb036 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:10.263047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2b18-6680-471b-a1d4-5094d90eb036 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:10.276527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c2b18-6680-471b-a1d4-5094d90eb036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-f14c2b18-6680-471b-a1d4-5094d90eb036 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:10.286015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:10.287010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:10.287802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:10.290393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 101/191] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:10.296806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2b18-6680-471b-a1d4-5094d90eb036 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:10.338945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d98cf9-c694-4f85-bbbf-9c8b270070d3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:10.375724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f411-41ef-4ab6-b598-e3c4dab44f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:10.377735 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f411-41ef-4ab6-b598-e3c4dab44f50 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:10.378749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f411-41ef-4ab6-b598-e3c4dab44f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:10.379226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f411-41ef-4ab6-b598-e3c4dab44f50 None admin] PATH_INFO: `/v3/users/5b01b8a9f196476e9b1453f7da3c69a8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:10.395016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f411-41ef-4ab6-b598-e3c4dab44f50 None admin] RBAC: Authorizing `identity:get_user(user_id=5b01b8a9f196476e9b1453f7da3c69a8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:10.397017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f411-41ef-4ab6-b598-e3c4dab44f50 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:10.399378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 91/192] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:10 2022] GET /identity/v3/users/5b01b8a9f196476e9b1453f7da3c69a8 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:10.405882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f411-41ef-4ab6-b598-e3c4dab44f50 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:10.410167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2b18-6680-471b-a1d4-5094d90eb036 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:10.452730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abb374-4ae9-47a6-bbed-8952e6fe85e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:10.452730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb374-4ae9-47a6-bbed-8952e6fe85e2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:10.452730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb374-4ae9-47a6-bbed-8952e6fe85e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:10.452730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb374-4ae9-47a6-bbed-8952e6fe85e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:10.453093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abb374-4ae9-47a6-bbed-8952e6fe85e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:10.453404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abb374-4ae9-47a6-bbed-8952e6fe85e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:10.454830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abb374-4ae9-47a6-bbed-8952e6fe85e2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:10.464830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 102/193] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:10.470305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abb374-4ae9-47a6-bbed-8952e6fe85e2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:10.534911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f411-41ef-4ab6-b598-e3c4dab44f50 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:10.574994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b5eb8-90f3-4c40-a947-7cdfee1913e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:10.575654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b5eb8-90f3-4c40-a947-7cdfee1913e9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:10.575932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b5eb8-90f3-4c40-a947-7cdfee1913e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:10.576203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b5eb8-90f3-4c40-a947-7cdfee1913e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:10.594897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abb374-4ae9-47a6-bbed-8952e6fe85e2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:10.639306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db45d-812c-46f5-99a9-8656c920527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:10.640186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db45d-812c-46f5-99a9-8656c920527d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:10.640462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db45d-812c-46f5-99a9-8656c920527d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:10.640732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db45d-812c-46f5-99a9-8656c920527d None admin] PATH_INFO: `/v3/users/5b01b8a9f196476e9b1453f7da3c69a8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:10.644495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2db45d-812c-46f5-99a9-8656c920527d None admin] RBAC: Authorizing `identity:get_user(user_id=5b01b8a9f196476e9b1453f7da3c69a8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:10.645585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2db45d-812c-46f5-99a9-8656c920527d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:10.647270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 103/194] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:10 2022] GET /identity/v3/users/5b01b8a9f196476e9b1453f7da3c69a8 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:10.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db45d-812c-46f5-99a9-8656c920527d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:10.661622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b5eb8-90f3-4c40-a947-7cdfee1913e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:10.663158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b5eb8-90f3-4c40-a947-7cdfee1913e9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:10.774701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db45d-812c-46f5-99a9-8656c920527d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:10.794093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 92/195] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:10.796833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b5eb8-90f3-4c40-a947-7cdfee1913e9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:10.814095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91315ff9-4bbd-4596-b075-41f09cdfb989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:10.814764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91315ff9-4bbd-4596-b075-41f09cdfb989 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:10.815046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91315ff9-4bbd-4596-b075-41f09cdfb989 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:10.815851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91315ff9-4bbd-4596-b075-41f09cdfb989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:10.885283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91315ff9-4bbd-4596-b075-41f09cdfb989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:10.886775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91315ff9-4bbd-4596-b075-41f09cdfb989 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:10.898388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b5eb8-90f3-4c40-a947-7cdfee1913e9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:10.956410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b768-9d57-49d1-9bb2-68203e140bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:10.957624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b768-9d57-49d1-9bb2-68203e140bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:10.957913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b768-9d57-49d1-9bb2-68203e140bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:10.958221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b768-9d57-49d1-9bb2-68203e140bc1 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:10.959446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b768-9d57-49d1-9bb2-68203e140bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:10.961160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b768-9d57-49d1-9bb2-68203e140bc1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:10.963211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 93/196] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:10 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:10.968877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b768-9d57-49d1-9bb2-68203e140bc1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:11.044885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 104/197] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:11.051000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91315ff9-4bbd-4596-b075-41f09cdfb989 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:11.176831 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b768-9d57-49d1-9bb2-68203e140bc1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:11.177027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91315ff9-4bbd-4596-b075-41f09cdfb989 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:11.214344 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119cbd9-669d-43cf-8e64-85af85ffb6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:11.215377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119cbd9-669d-43cf-8e64-85af85ffb6ea None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:11.215660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119cbd9-669d-43cf-8e64-85af85ffb6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:11.215933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119cbd9-669d-43cf-8e64-85af85ffb6ea None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:11.217495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119cbd9-669d-43cf-8e64-85af85ffb6ea None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:11.220746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119cbd9-669d-43cf-8e64-85af85ffb6ea None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:11.220857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 105/198] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:11 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:11.226634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119cbd9-669d-43cf-8e64-85af85ffb6ea None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:11.275295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbf3bc-8770-43e2-bd86-ca599135709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:11.276308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbf3bc-8770-43e2-bd86-ca599135709c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:11.276813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbf3bc-8770-43e2-bd86-ca599135709c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:11.277299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbf3bc-8770-43e2-bd86-ca599135709c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:11.278363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbf3bc-8770-43e2-bd86-ca599135709c None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=da3df20a1f56481987bf9fc24fcac939, user.id=5b01b8a9f196476e9b1453f7da3c69a8) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:11.278892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbf3bc-8770-43e2-bd86-ca599135709c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:11.280547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbf3bc-8770-43e2-bd86-ca599135709c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:11.289954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 94/199] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:10 2022] GET /identity/v3/role_assignments?user.id=5b01b8a9f196476e9b1453f7da3c69a8&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=042169a166e14a80beac826291ceaf73 => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:11.325581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119cbd9-669d-43cf-8e64-85af85ffb6ea None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:11.362598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68604eb8-8430-4ed5-bacc-f061a5d5c7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:11.363266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68604eb8-8430-4ed5-bacc-f061a5d5c7be None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:11.363543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68604eb8-8430-4ed5-bacc-f061a5d5c7be None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:11.363814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68604eb8-8430-4ed5-bacc-f061a5d5c7be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:11.364659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68604eb8-8430-4ed5-bacc-f061a5d5c7be None admin] RBAC: Adding query filter params (role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=da3df20a1f56481987bf9fc24fcac939, user.id=5b01b8a9f196476e9b1453f7da3c69a8) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:11.364965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68604eb8-8430-4ed5-bacc-f061a5d5c7be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:11.366468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68604eb8-8430-4ed5-bacc-f061a5d5c7be None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:11.372625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 106/200] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:11 2022] GET /identity/v3/role_assignments?user.id=5b01b8a9f196476e9b1453f7da3c69a8&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=638115ca27864c64a0554c5c0913956a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:11.660719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b528b2-0782-4fa3-acf0-9c253177231e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:11.661200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b528b2-0782-4fa3-acf0-9c253177231e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:11.661200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b528b2-0782-4fa3-acf0-9c253177231e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:11.662767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 95/201] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:11.668833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c2359-adff-4f14-8a8d-5dcd03e11dbc None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:11.669121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c2359-adff-4f14-8a8d-5dcd03e11dbc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:11.669394 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c2359-adff-4f14-8a8d-5dcd03e11dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:11.689124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-748c2359-adff-4f14-8a8d-5dcd03e11dbc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:11.690836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-748c2359-adff-4f14-8a8d-5dcd03e11dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:11.769357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 107/202] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:11.812597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b528b2-0782-4fa3-acf0-9c253177231e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:11.953191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b528b2-0782-4fa3-acf0-9c253177231e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:11.995891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28605f2-ebda-4cce-9ad3-03b2f789759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:11.996684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28605f2-ebda-4cce-9ad3-03b2f789759e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:11.996957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28605f2-ebda-4cce-9ad3-03b2f789759e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:11.997223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28605f2-ebda-4cce-9ad3-03b2f789759e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:12.019502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28605f2-ebda-4cce-9ad3-03b2f789759e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c28605f2-ebda-4cce-9ad3-03b2f789759e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:12.027180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:12.028052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:12.029234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 96/203] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:12.039214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c2359-adff-4f14-8a8d-5dcd03e11dbc None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:12.177161 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c2359-adff-4f14-8a8d-5dcd03e11dbc None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:12.222989 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31ecb2-9390-44a4-a477-2aa272e8bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:12.224027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31ecb2-9390-44a4-a477-2aa272e8bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:12.224498 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31ecb2-9390-44a4-a477-2aa272e8bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:12.224961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31ecb2-9390-44a4-a477-2aa272e8bc89 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:12.225914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31ecb2-9390-44a4-a477-2aa272e8bc89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:12.226429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31ecb2-9390-44a4-a477-2aa272e8bc89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:12.227991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31ecb2-9390-44a4-a477-2aa272e8bc89 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:12.241015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 108/204] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:12.246789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28605f2-ebda-4cce-9ad3-03b2f789759e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:12.396458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28605f2-ebda-4cce-9ad3-03b2f789759e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:12.441677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357c820-9108-4ab2-8ade-6185cb15ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:12.442579 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357c820-9108-4ab2-8ade-6185cb15ff50 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:12.442863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357c820-9108-4ab2-8ade-6185cb15ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:12.443136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357c820-9108-4ab2-8ade-6185cb15ff50 None admin] PATH_INFO: `/v3/users/c9c8ee24af83476cb33c836e60aba951` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:12.446756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357c820-9108-4ab2-8ade-6185cb15ff50 None admin] RBAC: Authorizing `identity:get_user(user_id=c9c8ee24af83476cb33c836e60aba951)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:12.448239 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357c820-9108-4ab2-8ade-6185cb15ff50 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:12.449888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 97/205] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:12 2022] GET /identity/v3/users/c9c8ee24af83476cb33c836e60aba951 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:12.455646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31ecb2-9390-44a4-a477-2aa272e8bc89 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:12.558605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31ecb2-9390-44a4-a477-2aa272e8bc89 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:12.591905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9d29-d8c5-410f-8745-075aee3ddfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:12.592559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9d29-d8c5-410f-8745-075aee3ddfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:12.592837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9d29-d8c5-410f-8745-075aee3ddfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:12.593112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a9d29-d8c5-410f-8745-075aee3ddfa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:12.659265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a9d29-d8c5-410f-8745-075aee3ddfa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:12.660716 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a9d29-d8c5-410f-8745-075aee3ddfa6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:12.759244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 109/206] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:12.764713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357c820-9108-4ab2-8ade-6185cb15ff50 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:12.871964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357c820-9108-4ab2-8ade-6185cb15ff50 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:12.904735 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fbcb4-e53f-451f-87a1-05a3b2fafecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:12.905596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fbcb4-e53f-451f-87a1-05a3b2fafecc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:12.905872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fbcb4-e53f-451f-87a1-05a3b2fafecc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:12.906195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fbcb4-e53f-451f-87a1-05a3b2fafecc None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:12.908437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fbcb4-e53f-451f-87a1-05a3b2fafecc None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:12.910077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fbcb4-e53f-451f-87a1-05a3b2fafecc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:12.912014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 98/207] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:12 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:12.917473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9d29-d8c5-410f-8745-075aee3ddfa6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:13.020032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a9d29-d8c5-410f-8745-075aee3ddfa6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:13.056242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4a9ad-2ff3-4487-98bb-f12680405f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:13.056899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4a9ad-2ff3-4487-98bb-f12680405f79 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:13.057175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4a9ad-2ff3-4487-98bb-f12680405f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:13.057445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4a9ad-2ff3-4487-98bb-f12680405f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:13.058300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4a9ad-2ff3-4487-98bb-f12680405f79 None admin] RBAC: Adding query filter params (role.id=f176776959444eaa8bec7f749a9a1687, scope.project.id=db8112f1b83d4722a9c6776f739c6c71, user.id=c9c8ee24af83476cb33c836e60aba951) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:13.058610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4a9ad-2ff3-4487-98bb-f12680405f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:13.060053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4a9ad-2ff3-4487-98bb-f12680405f79 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:13.066948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 110/208] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:12 2022] GET /identity/v3/role_assignments?user.id=c9c8ee24af83476cb33c836e60aba951&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=f176776959444eaa8bec7f749a9a1687 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:13.274415 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a27a1-6ff6-4beb-869e-e8492419aeb9 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:13.274767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a27a1-6ff6-4beb-869e-e8492419aeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:13.274867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a27a1-6ff6-4beb-869e-e8492419aeb9 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:13.276624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 99/209] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:13.282716 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450fb37-02d2-421e-b159-94a3629dc699 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:13.283035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450fb37-02d2-421e-b159-94a3629dc699 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:13.283275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450fb37-02d2-421e-b159-94a3629dc699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:13.303942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e450fb37-02d2-421e-b159-94a3629dc699 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:13.305122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e450fb37-02d2-421e-b159-94a3629dc699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:13.376788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 111/210] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:13.402439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a27a1-6ff6-4beb-869e-e8492419aeb9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:13.473570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952ba0-0991-471b-9197-a3adcf6feb6b None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:13.474097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952ba0-0991-471b-9197-a3adcf6feb6b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:13.474211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952ba0-0991-471b-9197-a3adcf6feb6b None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:13.476533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 112/211] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:13.482664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f2728-fa35-42ab-a351-b2e2722898bc None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:13.482966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f2728-fa35-42ab-a351-b2e2722898bc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:13.483243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f2728-fa35-42ab-a351-b2e2722898bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:13.505343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9f0f2728-fa35-42ab-a351-b2e2722898bc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:13.506848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9f0f2728-fa35-42ab-a351-b2e2722898bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:13.514971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a27a1-6ff6-4beb-869e-e8492419aeb9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:13.552649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9a294-a83b-48a9-bc09-2ee3e9b3cf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:13.553501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9a294-a83b-48a9-bc09-2ee3e9b3cf34 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:13.553783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9a294-a83b-48a9-bc09-2ee3e9b3cf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:13.554069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9a294-a83b-48a9-bc09-2ee3e9b3cf34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:13.555725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9a294-a83b-48a9-bc09-2ee3e9b3cf34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:13.557273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9a294-a83b-48a9-bc09-2ee3e9b3cf34 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:13.559952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 100/212] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:13.565916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9a294-a83b-48a9-bc09-2ee3e9b3cf34 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:13.588589 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 113/213] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:13.614509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f2728-fa35-42ab-a351-b2e2722898bc None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:13.676578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9a294-a83b-48a9-bc09-2ee3e9b3cf34 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:13.709948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047131b-0eab-4234-a12b-2eb2acf2c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:13.710906 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047131b-0eab-4234-a12b-2eb2acf2c78e None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:13.711179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047131b-0eab-4234-a12b-2eb2acf2c78e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:13.711448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047131b-0eab-4234-a12b-2eb2acf2c78e None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:13.712155 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047131b-0eab-4234-a12b-2eb2acf2c78e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:13.713590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047131b-0eab-4234-a12b-2eb2acf2c78e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:13.715288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f2728-fa35-42ab-a351-b2e2722898bc None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:13.755838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f4178-b3f9-44ba-aae2-c87b292cfa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:13.756636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f4178-b3f9-44ba-aae2-c87b292cfa8c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:13.756914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f4178-b3f9-44ba-aae2-c87b292cfa8c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:13.757189 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f4178-b3f9-44ba-aae2-c87b292cfa8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:13.767573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f4178-b3f9-44ba-aae2-c87b292cfa8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-1a3f4178-b3f9-44ba-aae2-c87b292cfa8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:13.775678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:13.776544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:13.777320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:13.778112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 114/214] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:13.782784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f4178-b3f9-44ba-aae2-c87b292cfa8c None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:13.821092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 101/215] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:13 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:55:13.903048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f4178-b3f9-44ba-aae2-c87b292cfa8c None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:13.940581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aeadc5-4d6e-4ccb-ab5f-5cb6f368cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:13.941259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aeadc5-4d6e-4ccb-ab5f-5cb6f368cc46 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:13.941538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aeadc5-4d6e-4ccb-ab5f-5cb6f368cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:13.941808 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aeadc5-4d6e-4ccb-ab5f-5cb6f368cc46 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:13.942594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aeadc5-4d6e-4ccb-ab5f-5cb6f368cc46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:13.942899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aeadc5-4d6e-4ccb-ab5f-5cb6f368cc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:13.944364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aeadc5-4d6e-4ccb-ab5f-5cb6f368cc46 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:13.953873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 115/216] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:13.959342 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047131b-0eab-4234-a12b-2eb2acf2c78e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:14.022349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e347-f7fc-4c0a-9c82-b46c23610939 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.022682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e347-f7fc-4c0a-9c82-b46c23610939 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.022917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e347-f7fc-4c0a-9c82-b46c23610939 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.025016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 116/217] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:14.030916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5acd7d-d123-4ee7-b34b-66745e6fd341 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.030916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5acd7d-d123-4ee7-b34b-66745e6fd341 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.031203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5acd7d-d123-4ee7-b34b-66745e6fd341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.050949 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-cb5acd7d-d123-4ee7-b34b-66745e6fd341 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:14.051718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-cb5acd7d-d123-4ee7-b34b-66745e6fd341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:14.082662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047131b-0eab-4234-a12b-2eb2acf2c78e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:14.134443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689d0c5-c730-4334-ac12-4ca30f82a642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:14.135961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689d0c5-c730-4334-ac12-4ca30f82a642 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.135961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689d0c5-c730-4334-ac12-4ca30f82a642 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.135961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689d0c5-c730-4334-ac12-4ca30f82a642 None admin] PATH_INFO: `/v3/users/9a1204d074b44608af0bd32fde6711de` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.140498 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 117/218] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:14.153756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689d0c5-c730-4334-ac12-4ca30f82a642 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1204d074b44608af0bd32fde6711de)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:14.155429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689d0c5-c730-4334-ac12-4ca30f82a642 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:14.156742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 102/219] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:13 2022] GET /identity/v3/users/9a1204d074b44608af0bd32fde6711de => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:14.162579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5acd7d-d123-4ee7-b34b-66745e6fd341 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:14.165829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689d0c5-c730-4334-ac12-4ca30f82a642 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:14.280332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5acd7d-d123-4ee7-b34b-66745e6fd341 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:14.294421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689d0c5-c730-4334-ac12-4ca30f82a642 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:14.314315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461c09d-218d-48cf-9773-00c2ff6f450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:14.315830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461c09d-218d-48cf-9773-00c2ff6f450f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.316288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461c09d-218d-48cf-9773-00c2ff6f450f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.316736 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461c09d-218d-48cf-9773-00c2ff6f450f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.335896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb49d3-1d0a-479c-8bff-35075b7d93d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:14.336694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb49d3-1d0a-479c-8bff-35075b7d93d6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.336963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb49d3-1d0a-479c-8bff-35075b7d93d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.337232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb49d3-1d0a-479c-8bff-35075b7d93d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.350589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb49d3-1d0a-479c-8bff-35075b7d93d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e5bb49d3-1d0a-479c-8bff-35075b7d93d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:14.360589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:14.361796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:14.363262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 103/220] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:14.363914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1c3d2-bad0-41a4-bc03-9a62d85f3af7 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.363914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1c3d2-bad0-41a4-bc03-9a62d85f3af7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.364293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1c3d2-bad0-41a4-bc03-9a62d85f3af7 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.366148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 104/221] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:14.371885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1c3d2-bad0-41a4-bc03-9a62d85f3af7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:14.397635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461c09d-218d-48cf-9773-00c2ff6f450f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:14.399161 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461c09d-218d-48cf-9773-00c2ff6f450f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:14.506985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1c3d2-bad0-41a4-bc03-9a62d85f3af7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:14.507700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 118/222] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 14:55:14.509088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01932f-1cbf-4854-a2f1-20d0639c3e54 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.509379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01932f-1cbf-4854-a2f1-20d0639c3e54 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.509656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01932f-1cbf-4854-a2f1-20d0639c3e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.526651 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-4c01932f-1cbf-4854-a2f1-20d0639c3e54 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:14.527833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4c01932f-1cbf-4854-a2f1-20d0639c3e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:14.550856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61a6f4-4919-43f4-a6ff-410f7a3b9f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:14.551537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61a6f4-4919-43f4-a6ff-410f7a3b9f43 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.551817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61a6f4-4919-43f4-a6ff-410f7a3b9f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.552092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61a6f4-4919-43f4-a6ff-410f7a3b9f43 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.552848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61a6f4-4919-43f4-a6ff-410f7a3b9f43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:14.553660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61a6f4-4919-43f4-a6ff-410f7a3b9f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:14.555437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61a6f4-4919-43f4-a6ff-410f7a3b9f43 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:14.567303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 105/223] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:14.568205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61a6f4-4919-43f4-a6ff-410f7a3b9f43 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:14.611860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 119/224] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:14.618593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01932f-1cbf-4854-a2f1-20d0639c3e54 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:14.696388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61a6f4-4919-43f4-a6ff-410f7a3b9f43 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:14.729728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01932f-1cbf-4854-a2f1-20d0639c3e54 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:14.741938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cd2d9-3f3a-4a50-8c85-309232a55cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:14.742831 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd2d9-3f3a-4a50-8c85-309232a55cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.743116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd2d9-3f3a-4a50-8c85-309232a55cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.743389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd2d9-3f3a-4a50-8c85-309232a55cb3 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.746738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cd2d9-3f3a-4a50-8c85-309232a55cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:14.748866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cd2d9-3f3a-4a50-8c85-309232a55cb3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:14.750619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 106/225] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:14 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:14.751378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cd2d9-3f3a-4a50-8c85-309232a55cb3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:14.773027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9705fd-5805-4893-b7ed-a6b1c0351c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:14.774732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9705fd-5805-4893-b7ed-a6b1c0351c36 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.775465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9705fd-5805-4893-b7ed-a6b1c0351c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.776032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9705fd-5805-4893-b7ed-a6b1c0351c36 None admin] PATH_INFO: `/v3/users/5b01b8a9f196476e9b1453f7da3c69a8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.778092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9705fd-5805-4893-b7ed-a6b1c0351c36 None admin] RBAC: Authorizing `identity:get_user(user_id=5b01b8a9f196476e9b1453f7da3c69a8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:14.779919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9705fd-5805-4893-b7ed-a6b1c0351c36 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:14.782499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 120/226] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:14 2022] GET /identity/v3/users/5b01b8a9f196476e9b1453f7da3c69a8 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:14.787319 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9705fd-5805-4893-b7ed-a6b1c0351c36 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:14.860109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cd2d9-3f3a-4a50-8c85-309232a55cb3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:14.894914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9705fd-5805-4893-b7ed-a6b1c0351c36 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:14.902282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0237a1-96e7-4617-8849-4c5e488d033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:14.903082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0237a1-96e7-4617-8849-4c5e488d033f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.903411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0237a1-96e7-4617-8849-4c5e488d033f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.903681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0237a1-96e7-4617-8849-4c5e488d033f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.916673 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0237a1-96e7-4617-8849-4c5e488d033f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2f0237a1-96e7-4617-8849-4c5e488d033f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:14.927240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:14.928159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:14.928967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:14.933231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 107/227] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:55:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:14.934294 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0237a1-96e7-4617-8849-4c5e488d033f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:14.935713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d10e-538a-4794-8c14-951f47e9358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:14.936649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d10e-538a-4794-8c14-951f47e9358f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:14.937128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d10e-538a-4794-8c14-951f47e9358f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:14.937617 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d10e-538a-4794-8c14-951f47e9358f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:14.939074 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d10e-538a-4794-8c14-951f47e9358f None admin] RBAC: Adding query filter params (role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=da3df20a1f56481987bf9fc24fcac939, user.id=9a1204d074b44608af0bd32fde6711de) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:14.939592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d10e-538a-4794-8c14-951f47e9358f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:14.941361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d10e-538a-4794-8c14-951f47e9358f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:14.947593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 121/228] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:14 2022] GET /identity/v3/role_assignments?user.id=9a1204d074b44608af0bd32fde6711de&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:14.948678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d10e-538a-4794-8c14-951f47e9358f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:15.057079 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0237a1-96e7-4617-8849-4c5e488d033f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:15.103114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6d450-65ff-4f24-a914-ad0bbdc1ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:15.104547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6d450-65ff-4f24-a914-ad0bbdc1ba0a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:15.104969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6d450-65ff-4f24-a914-ad0bbdc1ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:15.105407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6d450-65ff-4f24-a914-ad0bbdc1ba0a None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:15.106954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6d450-65ff-4f24-a914-ad0bbdc1ba0a None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:15.109039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6d450-65ff-4f24-a914-ad0bbdc1ba0a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:15.111194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 108/229] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:14 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:15.119266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6d450-65ff-4f24-a914-ad0bbdc1ba0a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:15.155679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d10e-538a-4794-8c14-951f47e9358f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:15.226794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dc3ea-bf0c-4f57-9754-486258ab26c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:15.227878 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dc3ea-bf0c-4f57-9754-486258ab26c9 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:15.228357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dc3ea-bf0c-4f57-9754-486258ab26c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:15.228824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dc3ea-bf0c-4f57-9754-486258ab26c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:15.229821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dc3ea-bf0c-4f57-9754-486258ab26c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:15.231320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dc3ea-bf0c-4f57-9754-486258ab26c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:15.232994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dc3ea-bf0c-4f57-9754-486258ab26c9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:15.244909 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 122/230] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:15.250864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dc3ea-bf0c-4f57-9754-486258ab26c9 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:15.282192 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6d450-65ff-4f24-a914-ad0bbdc1ba0a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:15.343380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f5617-517c-4c7d-aa20-fd81917f4b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:15.344324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f5617-517c-4c7d-aa20-fd81917f4b07 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:15.344603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f5617-517c-4c7d-aa20-fd81917f4b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:15.344867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f5617-517c-4c7d-aa20-fd81917f4b07 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939/users/5b01b8a9f196476e9b1453f7da3c69a8/roles/638115ca27864c64a0554c5c0913956a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:15.349981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f5617-517c-4c7d-aa20-fd81917f4b07 None admin] RBAC: Authorizing `identity:create_grant(project_id=da3df20a1f56481987bf9fc24fcac939, user_id=5b01b8a9f196476e9b1453f7da3c69a8, role_id=638115ca27864c64a0554c5c0913956a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:15.352202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f5617-517c-4c7d-aa20-fd81917f4b07 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:15.400465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dc3ea-bf0c-4f57-9754-486258ab26c9 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:15.437974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c77eb5-8e0f-4fad-8472-d5dc79fd3497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:15.442234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 109/231] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:55:15 2022] PUT /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939/users/5b01b8a9f196476e9b1453f7da3c69a8/roles/638115ca27864c64a0554c5c0913956a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:55:15.443001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c77eb5-8e0f-4fad-8472-d5dc79fd3497 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:15.443282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c77eb5-8e0f-4fad-8472-d5dc79fd3497 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:15.443554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c77eb5-8e0f-4fad-8472-d5dc79fd3497 None admin] PATH_INFO: `/v3/users/5b01b8a9f196476e9b1453f7da3c69a8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:15.444956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c77eb5-8e0f-4fad-8472-d5dc79fd3497 None admin] RBAC: Authorizing `identity:get_user(user_id=5b01b8a9f196476e9b1453f7da3c69a8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:15.446629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c77eb5-8e0f-4fad-8472-d5dc79fd3497 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:15.448560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 123/232] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:15 2022] GET /identity/v3/users/5b01b8a9f196476e9b1453f7da3c69a8 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:15.459424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f5617-517c-4c7d-aa20-fd81917f4b07 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:15.601082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f5617-517c-4c7d-aa20-fd81917f4b07 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:15.636405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88a0b1-2cf0-46f7-ae1b-149040c05606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:15.637650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a0b1-2cf0-46f7-ae1b-149040c05606 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:15.638161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a0b1-2cf0-46f7-ae1b-149040c05606 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:15.638624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a0b1-2cf0-46f7-ae1b-149040c05606 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:15.640074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88a0b1-2cf0-46f7-ae1b-149040c05606 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:15.641524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88a0b1-2cf0-46f7-ae1b-149040c05606 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:15.643954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 110/233] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:15 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:15.649649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c77eb5-8e0f-4fad-8472-d5dc79fd3497 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:15.753300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c77eb5-8e0f-4fad-8472-d5dc79fd3497 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:15.791951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecca08e-70b0-4aeb-8b05-ea6bf08066e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:15.792848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca08e-70b0-4aeb-8b05-ea6bf08066e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:15.793128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca08e-70b0-4aeb-8b05-ea6bf08066e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:15.793396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca08e-70b0-4aeb-8b05-ea6bf08066e7 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939/users/5b01b8a9f196476e9b1453f7da3c69a8/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:15.795418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecca08e-70b0-4aeb-8b05-ea6bf08066e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=da3df20a1f56481987bf9fc24fcac939, user_id=5b01b8a9f196476e9b1453f7da3c69a8, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:15.796868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecca08e-70b0-4aeb-8b05-ea6bf08066e7 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:15.901536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 124/234] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:55:15 2022] PUT /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939/users/5b01b8a9f196476e9b1453f7da3c69a8/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:55:16.413039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac8e6-61dd-4cb8-82d8-aa6935038ddc None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:16.413518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac8e6-61dd-4cb8-82d8-aa6935038ddc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:16.413518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ac8e6-61dd-4cb8-82d8-aa6935038ddc None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:16.414924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 111/235] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:16.420431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcdf9c-5fb3-482b-a7b8-8abc8c97c54f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:16.420721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcdf9c-5fb3-482b-a7b8-8abc8c97c54f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:16.420999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcdf9c-5fb3-482b-a7b8-8abc8c97c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:16.421101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ed1ec-6b89-4ba4-b78a-84411fc0a178 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:16.421314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ed1ec-6b89-4ba4-b78a-84411fc0a178 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:16.421590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ed1ec-6b89-4ba4-b78a-84411fc0a178 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:16.423157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 112/236] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:16.438719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-74fcdf9c-5fb3-482b-a7b8-8abc8c97c54f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:16.439656 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f0f2d-d8b9-453a-949a-1179dd49bbc4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:16.440037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-74fcdf9c-5fb3-482b-a7b8-8abc8c97c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:16.440171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f0f2d-d8b9-453a-949a-1179dd49bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:16.440422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f0f2d-d8b9-453a-949a-1179dd49bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:16.475071 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8e2f0f2d-d8b9-453a-949a-1179dd49bbc4 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:16.476253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8e2f0f2d-d8b9-453a-949a-1179dd49bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:16.514203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 125/237] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:16.536049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcdf9c-5fb3-482b-a7b8-8abc8c97c54f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:16.610351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 113/238] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:16.633732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcdf9c-5fb3-482b-a7b8-8abc8c97c54f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:16.655609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f0f2d-d8b9-453a-949a-1179dd49bbc4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:16.667174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703526-11c6-4efd-a3fe-b133b8499945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:16.667957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703526-11c6-4efd-a3fe-b133b8499945 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:16.668243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703526-11c6-4efd-a3fe-b133b8499945 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:16.668516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703526-11c6-4efd-a3fe-b133b8499945 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:16.669688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703526-11c6-4efd-a3fe-b133b8499945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:16.671165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703526-11c6-4efd-a3fe-b133b8499945 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:16.672793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 126/239] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:16.678543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703526-11c6-4efd-a3fe-b133b8499945 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:16.776875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703526-11c6-4efd-a3fe-b133b8499945 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:16.810870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027819f-7e1d-4a74-ba4c-1b9ff8c79375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:16.811539 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027819f-7e1d-4a74-ba4c-1b9ff8c79375 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:16.811819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027819f-7e1d-4a74-ba4c-1b9ff8c79375 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:16.812091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027819f-7e1d-4a74-ba4c-1b9ff8c79375 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:16.812805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027819f-7e1d-4a74-ba4c-1b9ff8c79375 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:16.814276 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027819f-7e1d-4a74-ba4c-1b9ff8c79375 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:16.840853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f0f2d-d8b9-453a-949a-1179dd49bbc4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:16.875437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6448421-c443-41dd-aaa8-de617f5d312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:16.876251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6448421-c443-41dd-aaa8-de617f5d312a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:16.876528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6448421-c443-41dd-aaa8-de617f5d312a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:16.876797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6448421-c443-41dd-aaa8-de617f5d312a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:16.887049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6448421-c443-41dd-aaa8-de617f5d312a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c6448421-c443-41dd-aaa8-de617f5d312a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:16.894588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:16.896331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:16.897402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 114/240] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:16.901689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6448421-c443-41dd-aaa8-de617f5d312a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:16.916772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 127/241] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:16 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:55:17.012473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6448421-c443-41dd-aaa8-de617f5d312a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:17.047720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd814f4e-aeaf-469c-86f8-4af27c8b234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:17.048393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd814f4e-aeaf-469c-86f8-4af27c8b234a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:17.048673 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd814f4e-aeaf-469c-86f8-4af27c8b234a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:17.048947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd814f4e-aeaf-469c-86f8-4af27c8b234a None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:17.050344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd814f4e-aeaf-469c-86f8-4af27c8b234a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:17.050586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd814f4e-aeaf-469c-86f8-4af27c8b234a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:17.051970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd814f4e-aeaf-469c-86f8-4af27c8b234a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:17.060833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 115/242] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:17.066460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027819f-7e1d-4a74-ba4c-1b9ff8c79375 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:17.188949 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027819f-7e1d-4a74-ba4c-1b9ff8c79375 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:17.224005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089adcc4-a7be-4ebb-88ae-c28357b9e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:17.224873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adcc4-a7be-4ebb-88ae-c28357b9e625 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:17.225150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adcc4-a7be-4ebb-88ae-c28357b9e625 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:17.225419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adcc4-a7be-4ebb-88ae-c28357b9e625 None admin] PATH_INFO: `/v3/users/c097fa23a92846d6b8aefe36a1b6da58` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:17.239830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089adcc4-a7be-4ebb-88ae-c28357b9e625 None admin] RBAC: Authorizing `identity:get_user(user_id=c097fa23a92846d6b8aefe36a1b6da58)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:17.241296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089adcc4-a7be-4ebb-88ae-c28357b9e625 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:17.243121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 128/243] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:17 2022] GET /identity/v3/users/c097fa23a92846d6b8aefe36a1b6da58 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:17.248578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd814f4e-aeaf-469c-86f8-4af27c8b234a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:17.349284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd814f4e-aeaf-469c-86f8-4af27c8b234a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:17.382546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5127a6f-f5b5-4c2c-b25c-4b38b55cf773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:17.383207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5127a6f-f5b5-4c2c-b25c-4b38b55cf773 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:17.383483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5127a6f-f5b5-4c2c-b25c-4b38b55cf773 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:17.383753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5127a6f-f5b5-4c2c-b25c-4b38b55cf773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:17.451997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5127a6f-f5b5-4c2c-b25c-4b38b55cf773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:17.453474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5127a6f-f5b5-4c2c-b25c-4b38b55cf773 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:17.554211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 116/244] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:17.559907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089adcc4-a7be-4ebb-88ae-c28357b9e625 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:17.669273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089adcc4-a7be-4ebb-88ae-c28357b9e625 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:17.703287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb1605-1b27-4bb3-a4f7-8615b46ff17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:17.704150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb1605-1b27-4bb3-a4f7-8615b46ff17b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:17.704427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb1605-1b27-4bb3-a4f7-8615b46ff17b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:17.704697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb1605-1b27-4bb3-a4f7-8615b46ff17b None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:17.706481 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb1605-1b27-4bb3-a4f7-8615b46ff17b None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:17.707940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb1605-1b27-4bb3-a4f7-8615b46ff17b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:17.710002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 129/245] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:17 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:17.716097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5127a6f-f5b5-4c2c-b25c-4b38b55cf773 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:17.814134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5127a6f-f5b5-4c2c-b25c-4b38b55cf773 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:17.848192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fa3a4-b109-4ea1-823b-d893ce401a66 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:17.848521 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fa3a4-b109-4ea1-823b-d893ce401a66 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:17.848735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fa3a4-b109-4ea1-823b-d893ce401a66 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:17.850370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 130/246] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:17.856131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898722-bd33-456a-aa2c-a0f74b9655b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:17.856789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898722-bd33-456a-aa2c-a0f74b9655b9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:17.857065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898722-bd33-456a-aa2c-a0f74b9655b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:17.857333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898722-bd33-456a-aa2c-a0f74b9655b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:17.858194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9898722-bd33-456a-aa2c-a0f74b9655b9 None admin] RBAC: Adding query filter params (role.id=f176776959444eaa8bec7f749a9a1687, scope.project.id=da3df20a1f56481987bf9fc24fcac939, user.id=c097fa23a92846d6b8aefe36a1b6da58) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:17.858813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9898722-bd33-456a-aa2c-a0f74b9655b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:17.859802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9d43c-f1ab-4457-aa54-4418790b4699 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:17.860086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9d43c-f1ab-4457-aa54-4418790b4699 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:17.860273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9898722-bd33-456a-aa2c-a0f74b9655b9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:17.860427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9d43c-f1ab-4457-aa54-4418790b4699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:17.867207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 117/247] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:17 2022] GET /identity/v3/role_assignments?user.id=c097fa23a92846d6b8aefe36a1b6da58&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=f176776959444eaa8bec7f749a9a1687 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:17.883503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-05c9d43c-f1ab-4457-aa54-4418790b4699 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:17.884722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-05c9d43c-f1ab-4457-aa54-4418790b4699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:17.968511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 131/248] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:17.999939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898722-bd33-456a-aa2c-a0f74b9655b9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:18.126078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898722-bd33-456a-aa2c-a0f74b9655b9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:18.150275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841001-7bb2-4b0c-be0e-55ed57ff5139 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:18.150777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841001-7bb2-4b0c-be0e-55ed57ff5139 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:18.151186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841001-7bb2-4b0c-be0e-55ed57ff5139 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:18.152696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 132/249] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:18.173953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705cfbb-b1d2-4c2c-997e-2ac7d40a9684 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:18.174917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705cfbb-b1d2-4c2c-997e-2ac7d40a9684 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:18.175211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705cfbb-b1d2-4c2c-997e-2ac7d40a9684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:18.175643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8c6dc-6a9e-4c38-b663-cdcfe9422f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:18.176592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8c6dc-6a9e-4c38-b663-cdcfe9422f4e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:18.177009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8c6dc-6a9e-4c38-b663-cdcfe9422f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:18.177428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8c6dc-6a9e-4c38-b663-cdcfe9422f4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:18.197703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-0705cfbb-b1d2-4c2c-997e-2ac7d40a9684 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:18.200089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0705cfbb-b1d2-4c2c-997e-2ac7d40a9684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:18.213136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8c6dc-6a9e-4c38-b663-cdcfe9422f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-79a8c6dc-6a9e-4c38-b663-cdcfe9422f4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:18.221056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:18.222642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:18.223507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:18.227710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 118/250] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:18.233901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8c6dc-6a9e-4c38-b663-cdcfe9422f4e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:18.333194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 133/251] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:18.372913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705cfbb-b1d2-4c2c-997e-2ac7d40a9684 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:18.438598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8c6dc-6a9e-4c38-b663-cdcfe9422f4e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:18.485315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3730893-2632-421e-8241-b215f948e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:18.486670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3730893-2632-421e-8241-b215f948e396 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:18.487125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3730893-2632-421e-8241-b215f948e396 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:18.487539 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3730893-2632-421e-8241-b215f948e396 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:18.488451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3730893-2632-421e-8241-b215f948e396 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:18.488894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3730893-2632-421e-8241-b215f948e396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:18.490428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3730893-2632-421e-8241-b215f948e396 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:18.508817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 119/252] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:18.517651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3730893-2632-421e-8241-b215f948e396 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:18.597557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705cfbb-b1d2-4c2c-997e-2ac7d40a9684 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:18.680056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3730893-2632-421e-8241-b215f948e396 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:18.689393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0ae3f-6a94-4919-81b0-d34a13bd3132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:18.691380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0ae3f-6a94-4919-81b0-d34a13bd3132 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:18.691801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0ae3f-6a94-4919-81b0-d34a13bd3132 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:18.692231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0ae3f-6a94-4919-81b0-d34a13bd3132 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:18.716872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0ae3f-6a94-4919-81b0-d34a13bd3132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-9ce0ae3f-6a94-4919-81b0-d34a13bd3132 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:18.725356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:18.726291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:18.727053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:18.729725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 134/253] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:18.731376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edef020-a52f-438a-a067-fdd4c2d5d1dc None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:18.731919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edef020-a52f-438a-a067-fdd4c2d5d1dc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:18.732361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edef020-a52f-438a-a067-fdd4c2d5d1dc None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:18.733792 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 135/254] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:18.738187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07f393-70bc-4c3c-ab92-135f5d1d6841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:18.738187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f393-70bc-4c3c-ab92-135f5d1d6841 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:18.738187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f393-70bc-4c3c-ab92-135f5d1d6841 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:18.738187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07f393-70bc-4c3c-ab92-135f5d1d6841 None admin] PATH_INFO: `/v3/users/9a1204d074b44608af0bd32fde6711de` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:18.738491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07f393-70bc-4c3c-ab92-135f5d1d6841 None admin] RBAC: Authorizing `identity:get_user(user_id=9a1204d074b44608af0bd32fde6711de)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:18.739442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07f393-70bc-4c3c-ab92-135f5d1d6841 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:18.739796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edef020-a52f-438a-a067-fdd4c2d5d1dc None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:18.741695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 120/255] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:18 2022] GET /identity/v3/users/9a1204d074b44608af0bd32fde6711de => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:18.746032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70303ff-e94f-4cab-b156-204809465cd9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:18.746345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70303ff-e94f-4cab-b156-204809465cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:18.746624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70303ff-e94f-4cab-b156-204809465cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:18.771051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a70303ff-e94f-4cab-b156-204809465cd9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:18.772474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a70303ff-e94f-4cab-b156-204809465cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:18.900034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edef020-a52f-438a-a067-fdd4c2d5d1dc None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:18.911980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 121/256] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:18.912920 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70303ff-e94f-4cab-b156-204809465cd9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:18.936043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a67b45-285a-4803-9394-2db98df4825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:18.936995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67b45-285a-4803-9394-2db98df4825e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:18.937445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67b45-285a-4803-9394-2db98df4825e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:18.937882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67b45-285a-4803-9394-2db98df4825e None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:18.939084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a67b45-285a-4803-9394-2db98df4825e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:18.939761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a67b45-285a-4803-9394-2db98df4825e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:18.942250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a67b45-285a-4803-9394-2db98df4825e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:18.951680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 136/257] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:18.954491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a67b45-285a-4803-9394-2db98df4825e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:19.090866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70303ff-e94f-4cab-b156-204809465cd9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:19.096691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a67b45-285a-4803-9394-2db98df4825e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:19.129058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c88360-5686-4631-a996-e2d75e0efc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:19.129905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c88360-5686-4631-a996-e2d75e0efc18 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:19.130206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c88360-5686-4631-a996-e2d75e0efc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:19.130474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c88360-5686-4631-a996-e2d75e0efc18 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:19.132305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c88360-5686-4631-a996-e2d75e0efc18 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:19.133738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c88360-5686-4631-a996-e2d75e0efc18 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:19.135613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 122/258] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:18 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:19.138922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c88360-5686-4631-a996-e2d75e0efc18 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:19.165942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913983b-175c-4818-a152-d0ece26d0dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:19.166755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913983b-175c-4818-a152-d0ece26d0dbd None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:19.167033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913983b-175c-4818-a152-d0ece26d0dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:19.167308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913983b-175c-4818-a152-d0ece26d0dbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:19.187238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913983b-175c-4818-a152-d0ece26d0dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-5913983b-175c-4818-a152-d0ece26d0dbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:19.194746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:19.195601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:19.196381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:19.209974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 137/259] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:55:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:19.211103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913983b-175c-4818-a152-d0ece26d0dbd None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:19.293480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c88360-5686-4631-a996-e2d75e0efc18 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:19.338899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256f937-51e3-4295-9cf2-3764b33929fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:19.339698 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256f937-51e3-4295-9cf2-3764b33929fd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:19.339980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256f937-51e3-4295-9cf2-3764b33929fd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:19.340250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256f937-51e3-4295-9cf2-3764b33929fd None admin] PATH_INFO: `/v3/users/5b01b8a9f196476e9b1453f7da3c69a8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:19.347372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256f937-51e3-4295-9cf2-3764b33929fd None admin] RBAC: Authorizing `identity:get_user(user_id=5b01b8a9f196476e9b1453f7da3c69a8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:19.348835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256f937-51e3-4295-9cf2-3764b33929fd None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:19.350508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 123/260] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:19 2022] GET /identity/v3/users/5b01b8a9f196476e9b1453f7da3c69a8 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:19.351345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256f937-51e3-4295-9cf2-3764b33929fd None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:19.354214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913983b-175c-4818-a152-d0ece26d0dbd None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:19.399610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813fee-f1dc-4740-a2b2-674bf7caa25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:19.400505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813fee-f1dc-4740-a2b2-674bf7caa25d None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:19.400784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813fee-f1dc-4740-a2b2-674bf7caa25d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:19.401056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813fee-f1dc-4740-a2b2-674bf7caa25d None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939/users/9a1204d074b44608af0bd32fde6711de/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:19.407393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813fee-f1dc-4740-a2b2-674bf7caa25d None admin] RBAC: Authorizing `identity:create_grant(project_id=da3df20a1f56481987bf9fc24fcac939, user_id=9a1204d074b44608af0bd32fde6711de, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:19.409413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813fee-f1dc-4740-a2b2-674bf7caa25d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:19.460617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256f937-51e3-4295-9cf2-3764b33929fd None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:19.492574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 138/261] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:55:19 2022] PUT /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939/users/9a1204d074b44608af0bd32fde6711de/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:55:19.493429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813fee-f1dc-4740-a2b2-674bf7caa25d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:19.500178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80884b0-9ea3-4a2a-a636-ca492b22fc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:19.500872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80884b0-9ea3-4a2a-a636-ca492b22fc5a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:19.501111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80884b0-9ea3-4a2a-a636-ca492b22fc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:19.501380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80884b0-9ea3-4a2a-a636-ca492b22fc5a None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:19.502208 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80884b0-9ea3-4a2a-a636-ca492b22fc5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:19.502545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80884b0-9ea3-4a2a-a636-ca492b22fc5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:19.503985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80884b0-9ea3-4a2a-a636-ca492b22fc5a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:19.522732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 124/262] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:19.532228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80884b0-9ea3-4a2a-a636-ca492b22fc5a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:19.639165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80884b0-9ea3-4a2a-a636-ca492b22fc5a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:19.657082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813fee-f1dc-4740-a2b2-674bf7caa25d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:19.683854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dc10c-a042-41d3-8581-d238a2f16494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:19.684806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dc10c-a042-41d3-8581-d238a2f16494 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:19.685093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dc10c-a042-41d3-8581-d238a2f16494 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:19.685362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dc10c-a042-41d3-8581-d238a2f16494 None admin] PATH_INFO: `/v3/users/5b01b8a9f196476e9b1453f7da3c69a8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:19.691398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dc10c-a042-41d3-8581-d238a2f16494 None admin] RBAC: Authorizing `identity:get_user(user_id=5b01b8a9f196476e9b1453f7da3c69a8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:19.692880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dc10c-a042-41d3-8581-d238a2f16494 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:19.694817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 125/263] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:19 2022] GET /identity/v3/users/5b01b8a9f196476e9b1453f7da3c69a8 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:19.698140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4932849-b4fe-47ba-942f-0f02eab2b6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:19.698895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4932849-b4fe-47ba-942f-0f02eab2b6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:19.699965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dc10c-a042-41d3-8581-d238a2f16494 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:19.700603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4932849-b4fe-47ba-942f-0f02eab2b6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:19.700875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4932849-b4fe-47ba-942f-0f02eab2b6c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:19.845650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4932849-b4fe-47ba-942f-0f02eab2b6c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:19.847885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4932849-b4fe-47ba-942f-0f02eab2b6c1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:19.870480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dc10c-a042-41d3-8581-d238a2f16494 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:19.909253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62433493-226e-44ae-9c58-e50fb76dccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:19.910262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62433493-226e-44ae-9c58-e50fb76dccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:19.910685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62433493-226e-44ae-9c58-e50fb76dccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:19.911086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62433493-226e-44ae-9c58-e50fb76dccb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:19.949578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 139/264] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:19.972031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4932849-b4fe-47ba-942f-0f02eab2b6c1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:19.995341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62433493-226e-44ae-9c58-e50fb76dccb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:19.996815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62433493-226e-44ae-9c58-e50fb76dccb9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:20.095472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 126/265] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:20.103784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62433493-226e-44ae-9c58-e50fb76dccb9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:20.132240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4932849-b4fe-47ba-942f-0f02eab2b6c1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:20.217848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216ada7-9792-4a11-a97f-ea5386f72a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:20.218667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216ada7-9792-4a11-a97f-ea5386f72a3e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:20.219374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216ada7-9792-4a11-a97f-ea5386f72a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:20.219654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216ada7-9792-4a11-a97f-ea5386f72a3e None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:20.226937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216ada7-9792-4a11-a97f-ea5386f72a3e None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:20.228561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216ada7-9792-4a11-a97f-ea5386f72a3e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:20.230325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 140/266] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:19 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:20.237283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216ada7-9792-4a11-a97f-ea5386f72a3e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:20.352847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62433493-226e-44ae-9c58-e50fb76dccb9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:20.367723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216ada7-9792-4a11-a97f-ea5386f72a3e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:20.424039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84c6d0-25fb-4177-b11a-dc6b21436aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:20.425435 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c6d0-25fb-4177-b11a-dc6b21436aba None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:20.425714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c6d0-25fb-4177-b11a-dc6b21436aba None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:20.425982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c6d0-25fb-4177-b11a-dc6b21436aba None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:20.428099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84c6d0-25fb-4177-b11a-dc6b21436aba None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:20.429639 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84c6d0-25fb-4177-b11a-dc6b21436aba None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:20.431515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 127/267] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:20 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:20.439227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84c6d0-25fb-4177-b11a-dc6b21436aba None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:20.461026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f3dc3-b7f9-46a3-b31c-cc5778d720e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:20.461737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f3dc3-b7f9-46a3-b31c-cc5778d720e5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:20.462021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f3dc3-b7f9-46a3-b31c-cc5778d720e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:20.462314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f3dc3-b7f9-46a3-b31c-cc5778d720e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:20.463172 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f3dc3-b7f9-46a3-b31c-cc5778d720e5 None admin] RBAC: Adding query filter params (role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=da3df20a1f56481987bf9fc24fcac939, user.id=5b01b8a9f196476e9b1453f7da3c69a8) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:20.466079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f3dc3-b7f9-46a3-b31c-cc5778d720e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:20.466079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f3dc3-b7f9-46a3-b31c-cc5778d720e5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:20.478802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 141/268] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:20 2022] GET /identity/v3/role_assignments?user.id=5b01b8a9f196476e9b1453f7da3c69a8&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=638115ca27864c64a0554c5c0913956a => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:20.608062 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84c6d0-25fb-4177-b11a-dc6b21436aba None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:20.657300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6d960-61b3-4403-b9e8-de51e2d61373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:20.658350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6d960-61b3-4403-b9e8-de51e2d61373 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:20.659409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6d960-61b3-4403-b9e8-de51e2d61373 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:20.659873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6d960-61b3-4403-b9e8-de51e2d61373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:20.660897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6d960-61b3-4403-b9e8-de51e2d61373 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=da3df20a1f56481987bf9fc24fcac939, user.id=5b01b8a9f196476e9b1453f7da3c69a8) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:20.661431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6d960-61b3-4403-b9e8-de51e2d61373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:20.663088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6d960-61b3-4403-b9e8-de51e2d61373 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:20.675647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 128/269] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:20 2022] GET /identity/v3/role_assignments?user.id=5b01b8a9f196476e9b1453f7da3c69a8&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=042169a166e14a80beac826291ceaf73 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:20.776813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d32f5-6206-47d8-8f8c-7247ef65de3a None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:20.777312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d32f5-6206-47d8-8f8c-7247ef65de3a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:20.777312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d32f5-6206-47d8-8f8c-7247ef65de3a None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:20.778780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 142/270] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:20.785262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af502e-6b46-4c25-8faa-43db896f95ab None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:20.785880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af502e-6b46-4c25-8faa-43db896f95ab None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:20.786394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af502e-6b46-4c25-8faa-43db896f95ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:20.807456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c0af502e-6b46-4c25-8faa-43db896f95ab None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:20.809069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c0af502e-6b46-4c25-8faa-43db896f95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:20.900359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 129/271] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:20.937601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d32f5-6206-47d8-8f8c-7247ef65de3a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:21.061234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d32f5-6206-47d8-8f8c-7247ef65de3a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:21.106909 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400cd0c-adff-4d0f-9af5-bd59b5261d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:21.108255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400cd0c-adff-4d0f-9af5-bd59b5261d50 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.108722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400cd0c-adff-4d0f-9af5-bd59b5261d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.109136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400cd0c-adff-4d0f-9af5-bd59b5261d50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.110516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400cd0c-adff-4d0f-9af5-bd59b5261d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:21.112197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400cd0c-adff-4d0f-9af5-bd59b5261d50 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:21.114273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 143/272] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:21.121431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af502e-6b46-4c25-8faa-43db896f95ab None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:21.136254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b39a0-7c4c-4e85-8c8e-bed8248d638b None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.136885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b39a0-7c4c-4e85-8c8e-bed8248d638b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.137293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b39a0-7c4c-4e85-8c8e-bed8248d638b None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.138858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 144/273] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:21.141442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098ae9-beae-47ce-8bd6-bd1195b63b4e None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.141943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098ae9-beae-47ce-8bd6-bd1195b63b4e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.142462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098ae9-beae-47ce-8bd6-bd1195b63b4e None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.144762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 145/274] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:21.147913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d9c3f-7189-4df1-9e65-ff9599c8a27f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.148486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d9c3f-7189-4df1-9e65-ff9599c8a27f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.148957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d9c3f-7189-4df1-9e65-ff9599c8a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.168819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-690d9c3f-7189-4df1-9e65-ff9599c8a27f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:21.170388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-690d9c3f-7189-4df1-9e65-ff9599c8a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:21.245104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 146/275] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:21.246523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f93d1a-58a9-43fb-b918-f81bcdc713a2 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.246927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f93d1a-58a9-43fb-b918-f81bcdc713a2 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.247290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f93d1a-58a9-43fb-b918-f81bcdc713a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.253516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af502e-6b46-4c25-8faa-43db896f95ab None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:21.273447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-62f93d1a-58a9-43fb-b918-f81bcdc713a2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:21.275000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-62f93d1a-58a9-43fb-b918-f81bcdc713a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:21.288172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e90b35-2077-4109-8275-09ffbb51c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:21.288852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e90b35-2077-4109-8275-09ffbb51c403 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.289419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e90b35-2077-4109-8275-09ffbb51c403 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.289419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e90b35-2077-4109-8275-09ffbb51c403 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.290244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e90b35-2077-4109-8275-09ffbb51c403 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:21.291545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e90b35-2077-4109-8275-09ffbb51c403 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:21.339552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 147/276] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:21.340322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f93d1a-58a9-43fb-b918-f81bcdc713a2 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:21.406249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 130/277] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:21 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:21.407436 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e90b35-2077-4109-8275-09ffbb51c403 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:21.439677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f93d1a-58a9-43fb-b918-f81bcdc713a2 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:21.479911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27601034-c566-435b-9100-51d7bc3d3017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:21.480712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27601034-c566-435b-9100-51d7bc3d3017 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.480986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27601034-c566-435b-9100-51d7bc3d3017 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.481304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27601034-c566-435b-9100-51d7bc3d3017 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.493472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27601034-c566-435b-9100-51d7bc3d3017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-27601034-c566-435b-9100-51d7bc3d3017 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:21.501459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:21.503222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:21.504030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 148/278] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:21.511309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27601034-c566-435b-9100-51d7bc3d3017 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:21.551485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e90b35-2077-4109-8275-09ffbb51c403 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:21.600068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022c15-1fe4-493c-83d2-8b0354cad708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:21.600791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022c15-1fe4-493c-83d2-8b0354cad708 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.601078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022c15-1fe4-493c-83d2-8b0354cad708 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.601331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022c15-1fe4-493c-83d2-8b0354cad708 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.617217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022c15-1fe4-493c-83d2-8b0354cad708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9a022c15-1fe4-493c-83d2-8b0354cad708 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:21.625683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:21.626648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:21.627482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:21.629838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 131/279] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:21.635578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022c15-1fe4-493c-83d2-8b0354cad708 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:21.645678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27601034-c566-435b-9100-51d7bc3d3017 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:21.689201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3bdd8-293e-4d6b-b808-0bac3abf46c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:21.689954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3bdd8-293e-4d6b-b808-0bac3abf46c5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.690261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3bdd8-293e-4d6b-b808-0bac3abf46c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.690553 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3bdd8-293e-4d6b-b808-0bac3abf46c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.691285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3bdd8-293e-4d6b-b808-0bac3abf46c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:21.691584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3bdd8-293e-4d6b-b808-0bac3abf46c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:21.692979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3bdd8-293e-4d6b-b808-0bac3abf46c5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:21.701725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 149/280] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:21.708672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3bdd8-293e-4d6b-b808-0bac3abf46c5 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:21.758380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022c15-1fe4-493c-83d2-8b0354cad708 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:21.798465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25c0bc-1c50-4dd0-b3e7-e102a90e0f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:21.799438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25c0bc-1c50-4dd0-b3e7-e102a90e0f9e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.799863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25c0bc-1c50-4dd0-b3e7-e102a90e0f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.800275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25c0bc-1c50-4dd0-b3e7-e102a90e0f9e None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.801161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25c0bc-1c50-4dd0-b3e7-e102a90e0f9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:21.801617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25c0bc-1c50-4dd0-b3e7-e102a90e0f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:21.803764 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25c0bc-1c50-4dd0-b3e7-e102a90e0f9e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:21.815097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 132/281] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:21.820482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25c0bc-1c50-4dd0-b3e7-e102a90e0f9e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:21.833294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3bdd8-293e-4d6b-b808-0bac3abf46c5 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:21.867195 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2df9d9-27dd-4a79-9377-83b7ec8d1a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:21.868047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2df9d9-27dd-4a79-9377-83b7ec8d1a39 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.868328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2df9d9-27dd-4a79-9377-83b7ec8d1a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.868927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2df9d9-27dd-4a79-9377-83b7ec8d1a39 None admin] PATH_INFO: `/v3/users/c097fa23a92846d6b8aefe36a1b6da58` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.869817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2df9d9-27dd-4a79-9377-83b7ec8d1a39 None admin] RBAC: Authorizing `identity:get_user(user_id=c097fa23a92846d6b8aefe36a1b6da58)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:21.871315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2df9d9-27dd-4a79-9377-83b7ec8d1a39 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:21.873347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 150/282] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:21 2022] GET /identity/v3/users/c097fa23a92846d6b8aefe36a1b6da58 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:21.878781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2df9d9-27dd-4a79-9377-83b7ec8d1a39 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:21.927681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25c0bc-1c50-4dd0-b3e7-e102a90e0f9e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:21.962491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029dc67-752e-45f9-ade7-9aaf74e87b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:21.963731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029dc67-752e-45f9-ade7-9aaf74e87b9b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:21.964217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029dc67-752e-45f9-ade7-9aaf74e87b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:21.964684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029dc67-752e-45f9-ade7-9aaf74e87b9b None admin] PATH_INFO: `/v3/users/e062bd0374ea4870b542bdcd4cd41167` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:21.978305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029dc67-752e-45f9-ade7-9aaf74e87b9b None admin] RBAC: Authorizing `identity:get_user(user_id=e062bd0374ea4870b542bdcd4cd41167)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:21.979658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2df9d9-27dd-4a79-9377-83b7ec8d1a39 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:21.980320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029dc67-752e-45f9-ade7-9aaf74e87b9b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:21.982584 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 133/283] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:21 2022] GET /identity/v3/users/e062bd0374ea4870b542bdcd4cd41167 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:21.995038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029dc67-752e-45f9-ade7-9aaf74e87b9b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:22.020992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9ebd-c793-40c2-9e7e-45e01d4c3892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:22.021908 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9ebd-c793-40c2-9e7e-45e01d4c3892 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:22.022218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9ebd-c793-40c2-9e7e-45e01d4c3892 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:22.022489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea9ebd-c793-40c2-9e7e-45e01d4c3892 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:22.023857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9ebd-c793-40c2-9e7e-45e01d4c3892 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:22.025323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea9ebd-c793-40c2-9e7e-45e01d4c3892 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:22.031740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 151/284] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:21 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:22.032978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9ebd-c793-40c2-9e7e-45e01d4c3892 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:22.144851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea9ebd-c793-40c2-9e7e-45e01d4c3892 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:22.161548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029dc67-752e-45f9-ade7-9aaf74e87b9b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:22.178324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8674695-66fc-44aa-a402-5f7ea38a3b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:22.180189 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8674695-66fc-44aa-a402-5f7ea38a3b93 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:22.180871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8674695-66fc-44aa-a402-5f7ea38a3b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:22.181545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8674695-66fc-44aa-a402-5f7ea38a3b93 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939/users/c097fa23a92846d6b8aefe36a1b6da58/roles/f176776959444eaa8bec7f749a9a1687` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:22.184439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8674695-66fc-44aa-a402-5f7ea38a3b93 None admin] RBAC: Authorizing `identity:create_grant(project_id=da3df20a1f56481987bf9fc24fcac939, user_id=c097fa23a92846d6b8aefe36a1b6da58, role_id=f176776959444eaa8bec7f749a9a1687)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:22.186260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8674695-66fc-44aa-a402-5f7ea38a3b93 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:22.210909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0cf28-e568-47e3-b1d1-646cfdc15903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:22.212021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0cf28-e568-47e3-b1d1-646cfdc15903 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:22.212551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0cf28-e568-47e3-b1d1-646cfdc15903 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:22.213016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0cf28-e568-47e3-b1d1-646cfdc15903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:22.214080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0cf28-e568-47e3-b1d1-646cfdc15903 None admin] RBAC: Adding query filter params (role.id=d692349bc8bd4c8d940a2c7cacd96df8, user.id=e062bd0374ea4870b542bdcd4cd41167, scope.system=all) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:22.214915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0cf28-e568-47e3-b1d1-646cfdc15903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:22.217748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0cf28-e568-47e3-b1d1-646cfdc15903 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:22.224232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 134/285] 10.222.0.44 () {56 vars in 1308 bytes} [Mon May 16 14:55:21 2022] GET /identity/v3/role_assignments?user.id=e062bd0374ea4870b542bdcd4cd41167&scope.system=all&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:22.282985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 152/286] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:55:22 2022] PUT /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939/users/c097fa23a92846d6b8aefe36a1b6da58/roles/f176776959444eaa8bec7f749a9a1687 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:55:22.456946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fdc74-1243-4adb-a31c-d8057269494c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:22.456946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fdc74-1243-4adb-a31c-d8057269494c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:22.456946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fdc74-1243-4adb-a31c-d8057269494c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:22.456946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 135/287] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:22.463395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eac51-0885-43bf-a814-f6fb5ac41f86 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:22.464082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eac51-0885-43bf-a814-f6fb5ac41f86 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:22.464587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4eac51-0885-43bf-a814-f6fb5ac41f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:22.483638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-fe4eac51-0885-43bf-a814-f6fb5ac41f86 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:22.485198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fe4eac51-0885-43bf-a814-f6fb5ac41f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:22.556730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 153/288] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:22.579765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fdc74-1243-4adb-a31c-d8057269494c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:22.681498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fdc74-1243-4adb-a31c-d8057269494c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:22.716852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889f051-2a49-4ff3-b8e2-7b5156909ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:22.717964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889f051-2a49-4ff3-b8e2-7b5156909ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:22.718411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889f051-2a49-4ff3-b8e2-7b5156909ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:22.718836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889f051-2a49-4ff3-b8e2-7b5156909ed1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:22.729235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889f051-2a49-4ff3-b8e2-7b5156909ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-a889f051-2a49-4ff3-b8e2-7b5156909ed1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:22.737214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:22.738390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:22.739414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:22.741366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 136/289] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:22.747140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eac51-0885-43bf-a814-f6fb5ac41f86 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:22.851634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4eac51-0885-43bf-a814-f6fb5ac41f86 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:22.886075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c701bf7-0076-4cda-9e33-266bebbcb747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:22.887054 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c701bf7-0076-4cda-9e33-266bebbcb747 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:22.887479 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c701bf7-0076-4cda-9e33-266bebbcb747 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:22.887893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c701bf7-0076-4cda-9e33-266bebbcb747 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:22.888798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c701bf7-0076-4cda-9e33-266bebbcb747 None admin] RBAC: Adding query filter params (name=member) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:22.889243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c701bf7-0076-4cda-9e33-266bebbcb747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:22.890789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c701bf7-0076-4cda-9e33-266bebbcb747 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:22.899496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 154/290] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:22.905585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889f051-2a49-4ff3-b8e2-7b5156909ed1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:23.013004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889f051-2a49-4ff3-b8e2-7b5156909ed1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:23.059254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bb55e-d8fd-43c8-be8f-9722470c050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:23.060131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bb55e-d8fd-43c8-be8f-9722470c050d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:23.060410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bb55e-d8fd-43c8-be8f-9722470c050d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:23.060680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bb55e-d8fd-43c8-be8f-9722470c050d None admin] PATH_INFO: `/v3/users/9a1204d074b44608af0bd32fde6711de` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:23.066292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bb55e-d8fd-43c8-be8f-9722470c050d None admin] RBAC: Authorizing `identity:get_user(user_id=9a1204d074b44608af0bd32fde6711de)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:23.067802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bb55e-d8fd-43c8-be8f-9722470c050d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:23.069743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 137/291] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:22 2022] GET /identity/v3/users/9a1204d074b44608af0bd32fde6711de => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:23.075009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c701bf7-0076-4cda-9e33-266bebbcb747 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:23.215915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c701bf7-0076-4cda-9e33-266bebbcb747 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:23.261078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6a417-9d53-4167-a1f7-72079e97e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:23.261739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6a417-9d53-4167-a1f7-72079e97e336 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:23.262023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6a417-9d53-4167-a1f7-72079e97e336 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:23.262322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6a417-9d53-4167-a1f7-72079e97e336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:23.333153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6a417-9d53-4167-a1f7-72079e97e336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:23.334714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6a417-9d53-4167-a1f7-72079e97e336 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:23.435014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 155/292] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:23.446090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bb55e-d8fd-43c8-be8f-9722470c050d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:23.573457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bb55e-d8fd-43c8-be8f-9722470c050d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:23.612714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de8dee-cd0c-46b8-9824-df462bf9d7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:23.613492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de8dee-cd0c-46b8-9824-df462bf9d7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:23.613770 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de8dee-cd0c-46b8-9824-df462bf9d7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:23.614039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de8dee-cd0c-46b8-9824-df462bf9d7c4 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:23.615243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de8dee-cd0c-46b8-9824-df462bf9d7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:23.616693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de8dee-cd0c-46b8-9824-df462bf9d7c4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:23.618405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 138/293] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:23 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:23.624275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6a417-9d53-4167-a1f7-72079e97e336 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:23.765436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6a417-9d53-4167-a1f7-72079e97e336 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:23.817780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a98420-af82-4c91-a973-2a566d98aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:23.818480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98420-af82-4c91-a973-2a566d98aba3 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:23.818763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98420-af82-4c91-a973-2a566d98aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:23.819037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98420-af82-4c91-a973-2a566d98aba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:23.819878 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a98420-af82-4c91-a973-2a566d98aba3 None admin] RBAC: Adding query filter params (role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=da3df20a1f56481987bf9fc24fcac939, user.id=9a1204d074b44608af0bd32fde6711de) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:23.820187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a98420-af82-4c91-a973-2a566d98aba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:23.821682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a98420-af82-4c91-a973-2a566d98aba3 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:23.829959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 156/294] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:23 2022] GET /identity/v3/role_assignments?user.id=9a1204d074b44608af0bd32fde6711de&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:24.144995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa643a2-48ea-4094-bc58-73a91c6e0062 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.145526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa643a2-48ea-4094-bc58-73a91c6e0062 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.145526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa643a2-48ea-4094-bc58-73a91c6e0062 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.147245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 139/295] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:24.152098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71722fd8-317f-4a15-83e4-a09ada69b2d9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.152518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71722fd8-317f-4a15-83e4-a09ada69b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.152708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71722fd8-317f-4a15-83e4-a09ada69b2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.173479 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-71722fd8-317f-4a15-83e4-a09ada69b2d9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:24.174715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-71722fd8-317f-4a15-83e4-a09ada69b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:24.240863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 157/296] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:24.264466 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa643a2-48ea-4094-bc58-73a91c6e0062 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:24.422923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa643a2-48ea-4094-bc58-73a91c6e0062 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:24.459971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae31be-f463-46bb-87ec-ccd82d92ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:24.461105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae31be-f463-46bb-87ec-ccd82d92ce09 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.461379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae31be-f463-46bb-87ec-ccd82d92ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.461646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae31be-f463-46bb-87ec-ccd82d92ce09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.473972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae31be-f463-46bb-87ec-ccd82d92ce09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f4ae31be-f463-46bb-87ec-ccd82d92ce09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:24.481729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:24.482649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:24.483452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:24.488385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 140/297] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:24.489759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71722fd8-317f-4a15-83e4-a09ada69b2d9 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:24.584595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71722fd8-317f-4a15-83e4-a09ada69b2d9 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:24.622701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880996dc-e5c9-4ecb-96ee-9127b91deeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:24.623833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880996dc-e5c9-4ecb-96ee-9127b91deeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.624340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880996dc-e5c9-4ecb-96ee-9127b91deeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.624810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880996dc-e5c9-4ecb-96ee-9127b91deeb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.625773 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880996dc-e5c9-4ecb-96ee-9127b91deeb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:24.626306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880996dc-e5c9-4ecb-96ee-9127b91deeb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:24.627992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880996dc-e5c9-4ecb-96ee-9127b91deeb2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:24.629544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbf8af-2e84-4fc0-b15b-0ef30048c257 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.629835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbf8af-2e84-4fc0-b15b-0ef30048c257 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.630144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbf8af-2e84-4fc0-b15b-0ef30048c257 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.631761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 141/298] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:24.636905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc2b9a-0176-446f-9497-de2d9b5d0fec None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.637188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc2b9a-0176-446f-9497-de2d9b5d0fec None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.637463 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc2b9a-0176-446f-9497-de2d9b5d0fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.638935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 158/299] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:24.647143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880996dc-e5c9-4ecb-96ee-9127b91deeb2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:24.654415 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fcbc2b9a-0176-446f-9497-de2d9b5d0fec None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:24.655578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fcbc2b9a-0176-446f-9497-de2d9b5d0fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:24.735887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 142/300] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:24.757436 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc2b9a-0176-446f-9497-de2d9b5d0fec None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:24.767401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880996dc-e5c9-4ecb-96ee-9127b91deeb2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:24.800991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb4b52-f42b-4fc9-a621-782bf194a560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:24.801887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb4b52-f42b-4fc9-a621-782bf194a560 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.802262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb4b52-f42b-4fc9-a621-782bf194a560 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.802540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb4b52-f42b-4fc9-a621-782bf194a560 None admin] PATH_INFO: `/v3/users/672f7817a4c74ccabaa3aa9bb4580ff8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.818672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb4b52-f42b-4fc9-a621-782bf194a560 None admin] RBAC: Authorizing `identity:get_user(user_id=672f7817a4c74ccabaa3aa9bb4580ff8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:24.820432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb4b52-f42b-4fc9-a621-782bf194a560 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:24.822505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 159/301] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:24 2022] GET /identity/v3/users/672f7817a4c74ccabaa3aa9bb4580ff8 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:24.838130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb4b52-f42b-4fc9-a621-782bf194a560 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:24.888796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc2b9a-0176-446f-9497-de2d9b5d0fec None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:24.924023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a39e1b-edb5-40c5-b306-01e848cd69fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:24.925265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a39e1b-edb5-40c5-b306-01e848cd69fc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.925760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a39e1b-edb5-40c5-b306-01e848cd69fc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.926264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a39e1b-edb5-40c5-b306-01e848cd69fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.927634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a39e1b-edb5-40c5-b306-01e848cd69fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:24.929280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a39e1b-edb5-40c5-b306-01e848cd69fc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:24.930292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb4b52-f42b-4fc9-a621-782bf194a560 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:24.931684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 143/302] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:24.937000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a39e1b-edb5-40c5-b306-01e848cd69fc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:24.973781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92239b-b2aa-4bc7-959e-441f23d6cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:24.974964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92239b-b2aa-4bc7-959e-441f23d6cc5d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.975458 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92239b-b2aa-4bc7-959e-441f23d6cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.976360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92239b-b2aa-4bc7-959e-441f23d6cc5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.977398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92239b-b2aa-4bc7-959e-441f23d6cc5d None admin] RBAC: Adding query filter params (role.id=f176776959444eaa8bec7f749a9a1687, user.id=672f7817a4c74ccabaa3aa9bb4580ff8, scope.system=all) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:24.978302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92239b-b2aa-4bc7-959e-441f23d6cc5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:24.980535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92239b-b2aa-4bc7-959e-441f23d6cc5d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:24.987203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 160/303] 10.222.0.44 () {56 vars in 1308 bytes} [Mon May 16 14:55:24 2022] GET /identity/v3/role_assignments?user.id=672f7817a4c74ccabaa3aa9bb4580ff8&scope.system=all&role.id=f176776959444eaa8bec7f749a9a1687 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:24.996850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dded7-af0d-46ae-9b7a-e0ee14b7630d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:24.997198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dded7-af0d-46ae-9b7a-e0ee14b7630d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:24.997388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dded7-af0d-46ae-9b7a-e0ee14b7630d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:24.999612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 161/304] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:25.006804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec340b-0a40-4679-9b05-5b562d2cd54c None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.007127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec340b-0a40-4679-9b05-5b562d2cd54c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.007678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec340b-0a40-4679-9b05-5b562d2cd54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.032606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-17ec340b-0a40-4679-9b05-5b562d2cd54c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:25.034602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-17ec340b-0a40-4679-9b05-5b562d2cd54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:25.051463 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a39e1b-edb5-40c5-b306-01e848cd69fc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:25.093141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135b860-a18d-4b97-988f-84bca51f3a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:25.093805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135b860-a18d-4b97-988f-84bca51f3a5e None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.094102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135b860-a18d-4b97-988f-84bca51f3a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.094376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135b860-a18d-4b97-988f-84bca51f3a5e None admin] PATH_INFO: `/v3/groups` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.095564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135b860-a18d-4b97-988f-84bca51f3a5e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:25.098091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135b860-a18d-4b97-988f-84bca51f3a5e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:25.109148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 162/305] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:25.113713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0210-4624-4c0e-8ebc-193f6f4228d6 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.114017 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0210-4624-4c0e-8ebc-193f6f4228d6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.114487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0210-4624-4c0e-8ebc-193f6f4228d6 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.115813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 163/306] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:25.121565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aedd2f-e5a1-4ce8-90c8-7f7439701516 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.127159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aedd2f-e5a1-4ce8-90c8-7f7439701516 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.127159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aedd2f-e5a1-4ce8-90c8-7f7439701516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.139571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-79aedd2f-e5a1-4ce8-90c8-7f7439701516 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:25.140774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-79aedd2f-e5a1-4ce8-90c8-7f7439701516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:25.181787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 144/307] 10.222.0.44 () {60 vars in 1134 bytes} [Mon May 16 14:55:24 2022] POST /identity/v3/groups => generated 229 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:25.182922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135b860-a18d-4b97-988f-84bca51f3a5e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:25.211036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 164/308] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:25.234505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aedd2f-e5a1-4ce8-90c8-7f7439701516 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:25.313703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135b860-a18d-4b97-988f-84bca51f3a5e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:25.353718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348cd1-6f3b-4c9d-bee4-ed1c1c3b5a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:25.355504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348cd1-6f3b-4c9d-bee4-ed1c1c3b5a23 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.355955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348cd1-6f3b-4c9d-bee4-ed1c1c3b5a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.356548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348cd1-6f3b-4c9d-bee4-ed1c1c3b5a23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.360721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aedd2f-e5a1-4ce8-90c8-7f7439701516 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:25.371895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09348cd1-6f3b-4c9d-bee4-ed1c1c3b5a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-09348cd1-6f3b-4c9d-bee4-ed1c1c3b5a23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:25.381560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:25.382595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:25.383603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:25.384339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 145/309] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:25.390320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348cd1-6f3b-4c9d-bee4-ed1c1c3b5a23 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:25.411507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11366d46-6920-467a-9b12-91fd23318edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:25.412305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11366d46-6920-467a-9b12-91fd23318edf None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.412585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11366d46-6920-467a-9b12-91fd23318edf None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.412857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11366d46-6920-467a-9b12-91fd23318edf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.423218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11366d46-6920-467a-9b12-91fd23318edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-11366d46-6920-467a-9b12-91fd23318edf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:25.431423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:25.432300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:25.433871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 165/310] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:25.439334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11366d46-6920-467a-9b12-91fd23318edf None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:25.505909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348cd1-6f3b-4c9d-bee4-ed1c1c3b5a23 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:25.539557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fae0a-e771-4d06-8cb4-a2685f77515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:25.540334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fae0a-e771-4d06-8cb4-a2685f77515e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.540687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fae0a-e771-4d06-8cb4-a2685f77515e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.541031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fae0a-e771-4d06-8cb4-a2685f77515e None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.541855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fae0a-e771-4d06-8cb4-a2685f77515e None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:25.542251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fae0a-e771-4d06-8cb4-a2685f77515e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:25.543715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fae0a-e771-4d06-8cb4-a2685f77515e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:25.552845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 146/311] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:25.558003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fae0a-e771-4d06-8cb4-a2685f77515e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:25.565798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11366d46-6920-467a-9b12-91fd23318edf None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:25.609672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebbfb9-8ca1-40fb-badf-18ccf0e4f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:25.610816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebbfb9-8ca1-40fb-badf-18ccf0e4f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.611105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebbfb9-8ca1-40fb-badf-18ccf0e4f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.611379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebbfb9-8ca1-40fb-badf-18ccf0e4f1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.612945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebbfb9-8ca1-40fb-badf-18ccf0e4f1a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:25.613398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebbfb9-8ca1-40fb-badf-18ccf0e4f1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:25.615407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebbfb9-8ca1-40fb-badf-18ccf0e4f1a0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:25.630818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 166/312] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:25.631678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebbfb9-8ca1-40fb-badf-18ccf0e4f1a0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:25.670047 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fae0a-e771-4d06-8cb4-a2685f77515e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:25.706224 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8eb4b-b161-4e0a-bb4d-c6b284103d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:25.707100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8eb4b-b161-4e0a-bb4d-c6b284103d8c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.707381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8eb4b-b161-4e0a-bb4d-c6b284103d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.707652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8eb4b-b161-4e0a-bb4d-c6b284103d8c None admin] PATH_INFO: `/v3/users/e062bd0374ea4870b542bdcd4cd41167` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.708853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8eb4b-b161-4e0a-bb4d-c6b284103d8c None admin] RBAC: Authorizing `identity:get_user(user_id=e062bd0374ea4870b542bdcd4cd41167)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:25.710355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8eb4b-b161-4e0a-bb4d-c6b284103d8c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:25.712246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 147/313] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:25 2022] GET /identity/v3/users/e062bd0374ea4870b542bdcd4cd41167 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:25.717667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8eb4b-b161-4e0a-bb4d-c6b284103d8c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:25.740604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebbfb9-8ca1-40fb-badf-18ccf0e4f1a0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:25.782800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c91c5-613b-453f-a8cf-2eef108014b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:25.783864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c91c5-613b-453f-a8cf-2eef108014b4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.784609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c91c5-613b-453f-a8cf-2eef108014b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.784900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c91c5-613b-453f-a8cf-2eef108014b4 None admin] PATH_INFO: `/v3/users/c097fa23a92846d6b8aefe36a1b6da58` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.786330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c91c5-613b-453f-a8cf-2eef108014b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c097fa23a92846d6b8aefe36a1b6da58)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:25.788721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c91c5-613b-453f-a8cf-2eef108014b4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:25.790748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 167/314] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:25 2022] GET /identity/v3/users/c097fa23a92846d6b8aefe36a1b6da58 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:25.797267 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c91c5-613b-453f-a8cf-2eef108014b4 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:25.821708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8eb4b-b161-4e0a-bb4d-c6b284103d8c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:25.856440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c279f4e-cdda-4ef4-a07a-510f68b58741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:25.857329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c279f4e-cdda-4ef4-a07a-510f68b58741 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.857605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c279f4e-cdda-4ef4-a07a-510f68b58741 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.857874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c279f4e-cdda-4ef4-a07a-510f68b58741 None admin] PATH_INFO: `/v3/system/users/e062bd0374ea4870b542bdcd4cd41167/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.859438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c279f4e-cdda-4ef4-a07a-510f68b58741 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e062bd0374ea4870b542bdcd4cd41167, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:25.860930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c279f4e-cdda-4ef4-a07a-510f68b58741 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:25.912532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c91c5-613b-453f-a8cf-2eef108014b4 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:25.944234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548df0f-f09b-4dc7-a483-b3c9e04bfaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:25.944926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548df0f-f09b-4dc7-a483-b3c9e04bfaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:25.945208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548df0f-f09b-4dc7-a483-b3c9e04bfaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:25.945482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548df0f-f09b-4dc7-a483-b3c9e04bfaf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:25.964652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 148/315] 10.222.0.44 () {58 vars in 1334 bytes} [Mon May 16 14:55:25 2022] PUT /identity/v3/system/users/e062bd0374ea4870b542bdcd4cd41167/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:55:26.030629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548df0f-f09b-4dc7-a483-b3c9e04bfaf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:26.032592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548df0f-f09b-4dc7-a483-b3c9e04bfaf1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:26.145894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 168/316] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:26.153574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c279f4e-cdda-4ef4-a07a-510f68b58741 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:26.253230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c279f4e-cdda-4ef4-a07a-510f68b58741 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:26.284891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909fa04-0a93-4ac7-a769-1c517af9f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:26.285747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fa04-0a93-4ac7-a769-1c517af9f5dd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:26.286023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fa04-0a93-4ac7-a769-1c517af9f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:26.286335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fa04-0a93-4ac7-a769-1c517af9f5dd None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:26.287510 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909fa04-0a93-4ac7-a769-1c517af9f5dd None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:26.288944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909fa04-0a93-4ac7-a769-1c517af9f5dd None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:26.290657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 149/317] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:26 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:26.296825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548df0f-f09b-4dc7-a483-b3c9e04bfaf1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:26.396506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548df0f-f09b-4dc7-a483-b3c9e04bfaf1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:26.430906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269d83d-dac0-4502-a42f-30302d51c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:26.431999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269d83d-dac0-4502-a42f-30302d51c201 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:26.432539 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269d83d-dac0-4502-a42f-30302d51c201 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:26.433003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269d83d-dac0-4502-a42f-30302d51c201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:26.434079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269d83d-dac0-4502-a42f-30302d51c201 None admin] RBAC: Adding query filter params (role.id=f176776959444eaa8bec7f749a9a1687, scope.project.id=da3df20a1f56481987bf9fc24fcac939, user.id=c097fa23a92846d6b8aefe36a1b6da58) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:26.434626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269d83d-dac0-4502-a42f-30302d51c201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:26.436304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269d83d-dac0-4502-a42f-30302d51c201 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:26.444235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 169/318] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:26 2022] GET /identity/v3/role_assignments?user.id=c097fa23a92846d6b8aefe36a1b6da58&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=f176776959444eaa8bec7f749a9a1687 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:27.251664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dfc8a-d65a-4250-a446-a92e27e00a50 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.252054 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dfc8a-d65a-4250-a446-a92e27e00a50 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.252800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dfc8a-d65a-4250-a446-a92e27e00a50 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.254175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 150/319] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:27.259417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768747a-8675-4f75-972f-b415f6394d01 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.259709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768747a-8675-4f75-972f-b415f6394d01 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.259986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768747a-8675-4f75-972f-b415f6394d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.276831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a768747a-8675-4f75-972f-b415f6394d01 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:27.278073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a768747a-8675-4f75-972f-b415f6394d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:27.342019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 170/320] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:27.365988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dfc8a-d65a-4250-a446-a92e27e00a50 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:27.463231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dfc8a-d65a-4250-a446-a92e27e00a50 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:27.495246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede09068-bfad-4361-91ce-73005b652bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:27.496034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede09068-bfad-4361-91ce-73005b652bce None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.496316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede09068-bfad-4361-91ce-73005b652bce None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.496590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede09068-bfad-4361-91ce-73005b652bce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.506478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede09068-bfad-4361-91ce-73005b652bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ede09068-bfad-4361-91ce-73005b652bce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:27.514073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:27.514917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:27.515702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:27.517046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 151/321] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:27.521163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768747a-8675-4f75-972f-b415f6394d01 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:27.544179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323695f9-b339-46ea-a89e-d4f3925e85a9 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.544484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323695f9-b339-46ea-a89e-d4f3925e85a9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.544748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323695f9-b339-46ea-a89e-d4f3925e85a9 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.546161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 152/322] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:27.551544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc69ec1-0f6d-4e38-8d41-6b49b78eb112 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.551833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc69ec1-0f6d-4e38-8d41-6b49b78eb112 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.552111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc69ec1-0f6d-4e38-8d41-6b49b78eb112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.568167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6dc69ec1-0f6d-4e38-8d41-6b49b78eb112 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:27.569346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6dc69ec1-0f6d-4e38-8d41-6b49b78eb112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:27.630992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768747a-8675-4f75-972f-b415f6394d01 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:27.635515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 153/323] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:27.657966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc69ec1-0f6d-4e38-8d41-6b49b78eb112 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:27.664497 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66dcd0-ae66-4751-ab5a-77125a99bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:27.665332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66dcd0-ae66-4751-ab5a-77125a99bf8d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.665770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66dcd0-ae66-4751-ab5a-77125a99bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.666231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66dcd0-ae66-4751-ab5a-77125a99bf8d None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.667109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66dcd0-ae66-4751-ab5a-77125a99bf8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:27.667548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66dcd0-ae66-4751-ab5a-77125a99bf8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:27.669035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66dcd0-ae66-4751-ab5a-77125a99bf8d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:27.677044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 171/324] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:27.682745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66dcd0-ae66-4751-ab5a-77125a99bf8d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:27.756883 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc69ec1-0f6d-4e38-8d41-6b49b78eb112 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:27.779135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66dcd0-ae66-4751-ab5a-77125a99bf8d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:27.792257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3214fb-c603-416d-ae90-f566fb96f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:27.793887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3214fb-c603-416d-ae90-f566fb96f318 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.794410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3214fb-c603-416d-ae90-f566fb96f318 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.794979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3214fb-c603-416d-ae90-f566fb96f318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.796556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3214fb-c603-416d-ae90-f566fb96f318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:27.798564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3214fb-c603-416d-ae90-f566fb96f318 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:27.800778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 154/325] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:27.806193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3214fb-c603-416d-ae90-f566fb96f318 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:27.812614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32f196-47ff-48d1-a57d-9b25a5cfa62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:27.813482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32f196-47ff-48d1-a57d-9b25a5cfa62d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.813761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32f196-47ff-48d1-a57d-9b25a5cfa62d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.814299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32f196-47ff-48d1-a57d-9b25a5cfa62d None admin] PATH_INFO: `/v3/users/672f7817a4c74ccabaa3aa9bb4580ff8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.815300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32f196-47ff-48d1-a57d-9b25a5cfa62d None admin] RBAC: Authorizing `identity:get_user(user_id=672f7817a4c74ccabaa3aa9bb4580ff8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:27.816739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32f196-47ff-48d1-a57d-9b25a5cfa62d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:27.818419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 172/326] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:27 2022] GET /identity/v3/users/672f7817a4c74ccabaa3aa9bb4580ff8 => generated 293 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:27.823765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32f196-47ff-48d1-a57d-9b25a5cfa62d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:27.903201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3214fb-c603-416d-ae90-f566fb96f318 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:27.920866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32f196-47ff-48d1-a57d-9b25a5cfa62d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:27.940161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bf1e7-8fba-47fe-a824-ab1b0029dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:27.940843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bf1e7-8fba-47fe-a824-ab1b0029dd83 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.941124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bf1e7-8fba-47fe-a824-ab1b0029dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.941397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bf1e7-8fba-47fe-a824-ab1b0029dd83 None admin] PATH_INFO: `/v3/groups` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.942114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bf1e7-8fba-47fe-a824-ab1b0029dd83 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:27.943560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bf1e7-8fba-47fe-a824-ab1b0029dd83 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:27.952990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bc954-49c0-40b6-9041-ab9fbc5358c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:27.953840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bc954-49c0-40b6-9041-ab9fbc5358c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:27.954174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bc954-49c0-40b6-9041-ab9fbc5358c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:27.954421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bc954-49c0-40b6-9041-ab9fbc5358c7 None admin] PATH_INFO: `/v3/system/users/672f7817a4c74ccabaa3aa9bb4580ff8/roles/f176776959444eaa8bec7f749a9a1687` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:27.956457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bc954-49c0-40b6-9041-ab9fbc5358c7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=672f7817a4c74ccabaa3aa9bb4580ff8, role_id=f176776959444eaa8bec7f749a9a1687)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:27.957802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bc954-49c0-40b6-9041-ab9fbc5358c7 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:28.044212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 155/327] 10.222.0.44 () {60 vars in 1134 bytes} [Mon May 16 14:55:27 2022] POST /identity/v3/groups => generated 226 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:55:28.101906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 173/328] 10.222.0.44 () {58 vars in 1334 bytes} [Mon May 16 14:55:27 2022] PUT /identity/v3/system/users/672f7817a4c74ccabaa3aa9bb4580ff8/roles/f176776959444eaa8bec7f749a9a1687 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:55:28.224385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db17c09-9082-45f0-ab91-943ca0af8503 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:28.224589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db17c09-9082-45f0-ab91-943ca0af8503 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:28.224836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db17c09-9082-45f0-ab91-943ca0af8503 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:28.226451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 156/329] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:28.232243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea854-3e85-4eac-bbdd-cdba34bcfec0 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:28.232520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea854-3e85-4eac-bbdd-cdba34bcfec0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:28.232801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea854-3e85-4eac-bbdd-cdba34bcfec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:28.252306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-622ea854-3e85-4eac-bbdd-cdba34bcfec0 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:28.253538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-622ea854-3e85-4eac-bbdd-cdba34bcfec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:28.326923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 174/330] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:28.351763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db17c09-9082-45f0-ab91-943ca0af8503 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:28.461804 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db17c09-9082-45f0-ab91-943ca0af8503 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:28.500158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72599b-6408-4d5e-8354-eee2b492a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:28.500884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72599b-6408-4d5e-8354-eee2b492a46e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:28.501163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72599b-6408-4d5e-8354-eee2b492a46e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:28.501429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72599b-6408-4d5e-8354-eee2b492a46e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:28.516331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72599b-6408-4d5e-8354-eee2b492a46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-7e72599b-6408-4d5e-8354-eee2b492a46e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:28.524815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:28.525760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:28.526684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:28.532774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 157/331] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:28.539220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea854-3e85-4eac-bbdd-cdba34bcfec0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:28.644418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea854-3e85-4eac-bbdd-cdba34bcfec0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:28.683246 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364198b1-cb3a-4888-adef-7bd9e164572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:28.684217 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364198b1-cb3a-4888-adef-7bd9e164572f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:28.684695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364198b1-cb3a-4888-adef-7bd9e164572f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:28.685134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364198b1-cb3a-4888-adef-7bd9e164572f None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:28.686075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364198b1-cb3a-4888-adef-7bd9e164572f None admin] RBAC: Adding query filter params (name=member) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:28.686551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364198b1-cb3a-4888-adef-7bd9e164572f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:28.688103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364198b1-cb3a-4888-adef-7bd9e164572f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:28.697981 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 175/332] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:28.703313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72599b-6408-4d5e-8354-eee2b492a46e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:28.817403 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72599b-6408-4d5e-8354-eee2b492a46e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:28.856043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2be92-4cc1-458a-ab62-c3873cfcc043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:28.856915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2be92-4cc1-458a-ab62-c3873cfcc043 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:28.857192 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2be92-4cc1-458a-ab62-c3873cfcc043 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:28.857525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2be92-4cc1-458a-ab62-c3873cfcc043 None admin] PATH_INFO: `/v3/users/e062bd0374ea4870b542bdcd4cd41167` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:28.860523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2be92-4cc1-458a-ab62-c3873cfcc043 None admin] RBAC: Authorizing `identity:get_user(user_id=e062bd0374ea4870b542bdcd4cd41167)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:28.862637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2be92-4cc1-458a-ab62-c3873cfcc043 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:28.864800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 158/333] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:28 2022] GET /identity/v3/users/e062bd0374ea4870b542bdcd4cd41167 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:28.870441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364198b1-cb3a-4888-adef-7bd9e164572f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:28.971456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364198b1-cb3a-4888-adef-7bd9e164572f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:29.006004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf61dd-bd69-4952-8591-7b2f8e87f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:29.006698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf61dd-bd69-4952-8591-7b2f8e87f478 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:29.006973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf61dd-bd69-4952-8591-7b2f8e87f478 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:29.007244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf61dd-bd69-4952-8591-7b2f8e87f478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:29.008083 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf61dd-bd69-4952-8591-7b2f8e87f478 None admin] RBAC: Adding query filter params (role.id=d692349bc8bd4c8d940a2c7cacd96df8, user.id=e062bd0374ea4870b542bdcd4cd41167, scope.system=all) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:29.008388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf61dd-bd69-4952-8591-7b2f8e87f478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:29.009816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf61dd-bd69-4952-8591-7b2f8e87f478 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:29.023135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 176/334] 10.222.0.44 () {56 vars in 1308 bytes} [Mon May 16 14:55:28 2022] GET /identity/v3/role_assignments?user.id=e062bd0374ea4870b542bdcd4cd41167&scope.system=all&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 510 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:30.643873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a843-0ccc-4a21-aec0-48ecdd1e3041 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:30.644394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a843-0ccc-4a21-aec0-48ecdd1e3041 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:30.644821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63a843-0ccc-4a21-aec0-48ecdd1e3041 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:30.646345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 159/335] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:30.651766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1c734-7409-4a23-af52-f31a16342644 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:30.652171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1c734-7409-4a23-af52-f31a16342644 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:30.652486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1c734-7409-4a23-af52-f31a16342644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:30.675194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a0b1c734-7409-4a23-af52-f31a16342644 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:30.676541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a0b1c734-7409-4a23-af52-f31a16342644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:30.751986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 177/336] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:30.784485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63a843-0ccc-4a21-aec0-48ecdd1e3041 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:30.895260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29147531-d5a6-46de-8ae0-84b5fc69ab75 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:30.895555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29147531-d5a6-46de-8ae0-84b5fc69ab75 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:30.895735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29147531-d5a6-46de-8ae0-84b5fc69ab75 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:30.897097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 178/337] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:30.897516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63a843-0ccc-4a21-aec0-48ecdd1e3041 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:30.902366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a94a4-0e1d-4894-aab0-fc1d215897ac None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:30.902650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a94a4-0e1d-4894-aab0-fc1d215897ac None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:30.902921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a94a4-0e1d-4894-aab0-fc1d215897ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:30.937725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-265a94a4-0e1d-4894-aab0-fc1d215897ac None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:30.942379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-265a94a4-0e1d-4894-aab0-fc1d215897ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:30.980929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdce80b-12ef-4aff-93c7-2a543ef2df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:30.981754 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdce80b-12ef-4aff-93c7-2a543ef2df8e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:30.982029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdce80b-12ef-4aff-93c7-2a543ef2df8e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:30.982324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdce80b-12ef-4aff-93c7-2a543ef2df8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:31.005566 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdce80b-12ef-4aff-93c7-2a543ef2df8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ebdce80b-12ef-4aff-93c7-2a543ef2df8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:31.017744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:31.019242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:31.020010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:31.026088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 160/338] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:31.026088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdce80b-12ef-4aff-93c7-2a543ef2df8e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:31.060303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 179/339] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 16 14:55:31.161667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdce80b-12ef-4aff-93c7-2a543ef2df8e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:31.188581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a94a4-0e1d-4894-aab0-fc1d215897ac None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:31.219685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55a6d9-942a-4a15-b434-895761c585d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:31.220366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55a6d9-942a-4a15-b434-895761c585d9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:31.220649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55a6d9-942a-4a15-b434-895761c585d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:31.220956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55a6d9-942a-4a15-b434-895761c585d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:31.221712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55a6d9-942a-4a15-b434-895761c585d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:31.222019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55a6d9-942a-4a15-b434-895761c585d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:31.223439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55a6d9-942a-4a15-b434-895761c585d9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:31.241565 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 161/340] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:31.242959 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb25a1-4e35-4554-83dd-ccebf8d0c07e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:31.243246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb25a1-4e35-4554-83dd-ccebf8d0c07e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:31.243519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb25a1-4e35-4554-83dd-ccebf8d0c07e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:31.245141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 162/341] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:31.250812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb25a1-4e35-4554-83dd-ccebf8d0c07e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:31.298153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a94a4-0e1d-4894-aab0-fc1d215897ac None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:31.333135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5306-1f5c-4c81-8024-d492201f540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:31.333947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5306-1f5c-4c81-8024-d492201f540e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:31.334720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5306-1f5c-4c81-8024-d492201f540e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:31.334996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5306-1f5c-4c81-8024-d492201f540e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:31.346886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c5306-1f5c-4c81-8024-d492201f540e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c41c5306-1f5c-4c81-8024-d492201f540e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:31.356126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:31.357237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:31.358212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:31.360454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 180/342] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:31.361946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b1b40-a3cf-47d4-8c0a-75457e699b78 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:31.362389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b1b40-a3cf-47d4-8c0a-75457e699b78 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:31.362815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b1b40-a3cf-47d4-8c0a-75457e699b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:31.380882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-976b1b40-a3cf-47d4-8c0a-75457e699b78 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:31.382462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-976b1b40-a3cf-47d4-8c0a-75457e699b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:31.479853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 181/343] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:31.481614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b1b40-a3cf-47d4-8c0a-75457e699b78 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:31.487872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb25a1-4e35-4554-83dd-ccebf8d0c07e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:31.553235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab24d-120e-4f25-8a3a-4bfca49a2c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:31.554169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab24d-120e-4f25-8a3a-4bfca49a2c4c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:31.555987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab24d-120e-4f25-8a3a-4bfca49a2c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:31.556402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab24d-120e-4f25-8a3a-4bfca49a2c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:31.639816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b1b40-a3cf-47d4-8c0a-75457e699b78 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:31.667114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ab24d-120e-4f25-8a3a-4bfca49a2c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:31.668594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ab24d-120e-4f25-8a3a-4bfca49a2c4c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:31.679915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3557f6-1846-4ce7-870e-1eebafa33d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:31.681082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3557f6-1846-4ce7-870e-1eebafa33d7e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:31.681503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3557f6-1846-4ce7-870e-1eebafa33d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:31.682405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3557f6-1846-4ce7-870e-1eebafa33d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:31.682934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3557f6-1846-4ce7-870e-1eebafa33d7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:31.683364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3557f6-1846-4ce7-870e-1eebafa33d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:31.684887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3557f6-1846-4ce7-870e-1eebafa33d7e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:31.694238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 182/344] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:31.695305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3557f6-1846-4ce7-870e-1eebafa33d7e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:31.801548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3557f6-1846-4ce7-870e-1eebafa33d7e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:31.839125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96bf3e-028a-421a-b4d1-2ef0381ab132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:31.840204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96bf3e-028a-421a-b4d1-2ef0381ab132 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:31.840622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96bf3e-028a-421a-b4d1-2ef0381ab132 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:31.841057 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96bf3e-028a-421a-b4d1-2ef0381ab132 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:31.851767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96bf3e-028a-421a-b4d1-2ef0381ab132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-2a96bf3e-028a-421a-b4d1-2ef0381ab132 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:31.861009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:31.862082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 14:55:31.862894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:31.865573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 183/345] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:31.866645 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96bf3e-028a-421a-b4d1-2ef0381ab132 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:31.881205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 163/346] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 14:55:31.885227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab24d-120e-4f25-8a3a-4bfca49a2c4c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:31.967860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96bf3e-028a-421a-b4d1-2ef0381ab132 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.002943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0216581-b30a-40a7-8546-b8c57746ccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.003901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0216581-b30a-40a7-8546-b8c57746ccd1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.004342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0216581-b30a-40a7-8546-b8c57746ccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.004770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0216581-b30a-40a7-8546-b8c57746ccd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.020190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab24d-120e-4f25-8a3a-4bfca49a2c4c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.055332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ff858-c3f2-4590-aafc-3394bb8727f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.055926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ff858-c3f2-4590-aafc-3394bb8727f7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.056465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ff858-c3f2-4590-aafc-3394bb8727f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.056465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ff858-c3f2-4590-aafc-3394bb8727f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.057195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ff858-c3f2-4590-aafc-3394bb8727f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:32.057498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ff858-c3f2-4590-aafc-3394bb8727f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.058931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ff858-c3f2-4590-aafc-3394bb8727f7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.067380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 164/347] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.068284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ff858-c3f2-4590-aafc-3394bb8727f7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.076711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0216581-b30a-40a7-8546-b8c57746ccd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.078634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0216581-b30a-40a7-8546-b8c57746ccd1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.168722 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ff858-c3f2-4590-aafc-3394bb8727f7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.179184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 184/348] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:32.180646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ca83f-ce92-4470-b4f3-55a9ddd8effa None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.180933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ca83f-ce92-4470-b4f3-55a9ddd8effa None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.181204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ca83f-ce92-4470-b4f3-55a9ddd8effa None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.182767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 185/349] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:32.183461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ca83f-ce92-4470-b4f3-55a9ddd8effa None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.202124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30229b-4b96-49ed-854f-0e633e0e9307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.202934 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30229b-4b96-49ed-854f-0e633e0e9307 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.203213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30229b-4b96-49ed-854f-0e633e0e9307 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.203483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30229b-4b96-49ed-854f-0e633e0e9307 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.204677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30229b-4b96-49ed-854f-0e633e0e9307 None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.206691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30229b-4b96-49ed-854f-0e633e0e9307 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.208408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 165/350] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.209727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a429684-dd79-4148-bee8-046850efd63a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.209998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a429684-dd79-4148-bee8-046850efd63a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.210310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a429684-dd79-4148-bee8-046850efd63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.227766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5a429684-dd79-4148-bee8-046850efd63a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:32.228951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5a429684-dd79-4148-bee8-046850efd63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:32.287462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ca83f-ce92-4470-b4f3-55a9ddd8effa None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.294159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 166/351] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:32.295141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a429684-dd79-4148-bee8-046850efd63a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.324252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf6a50-a44c-4d81-89e2-a0bf79fe0fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.325087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf6a50-a44c-4d81-89e2-a0bf79fe0fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.325365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf6a50-a44c-4d81-89e2-a0bf79fe0fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.325636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf6a50-a44c-4d81-89e2-a0bf79fe0fb9 None admin] PATH_INFO: `/v3/users/672f7817a4c74ccabaa3aa9bb4580ff8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.326961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf6a50-a44c-4d81-89e2-a0bf79fe0fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=672f7817a4c74ccabaa3aa9bb4580ff8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.328502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf6a50-a44c-4d81-89e2-a0bf79fe0fb9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.330886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 186/352] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/users/672f7817a4c74ccabaa3aa9bb4580ff8 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.331478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf6a50-a44c-4d81-89e2-a0bf79fe0fb9 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.392136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a429684-dd79-4148-bee8-046850efd63a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.428375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576886e7-9be9-4a23-b6d4-de87a8e2a3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.429258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576886e7-9be9-4a23-b6d4-de87a8e2a3ce None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.429536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576886e7-9be9-4a23-b6d4-de87a8e2a3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.429802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576886e7-9be9-4a23-b6d4-de87a8e2a3ce None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.431074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576886e7-9be9-4a23-b6d4-de87a8e2a3ce None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.432545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576886e7-9be9-4a23-b6d4-de87a8e2a3ce None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.434608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf6a50-a44c-4d81-89e2-a0bf79fe0fb9 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.434823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 167/353] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.435550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576886e7-9be9-4a23-b6d4-de87a8e2a3ce None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.474124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063e157-7da6-4ed2-91d0-b054668d38a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.474980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063e157-7da6-4ed2-91d0-b054668d38a4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.475257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063e157-7da6-4ed2-91d0-b054668d38a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.475535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063e157-7da6-4ed2-91d0-b054668d38a4 None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.481937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063e157-7da6-4ed2-91d0-b054668d38a4 None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.483433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063e157-7da6-4ed2-91d0-b054668d38a4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.485227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 187/354] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.485991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063e157-7da6-4ed2-91d0-b054668d38a4 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.539108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576886e7-9be9-4a23-b6d4-de87a8e2a3ce None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.572714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1656d-35f1-423c-a22d-b7f10e7e2de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.573509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1656d-35f1-423c-a22d-b7f10e7e2de8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.573785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1656d-35f1-423c-a22d-b7f10e7e2de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.574107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1656d-35f1-423c-a22d-b7f10e7e2de8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.586332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1656d-35f1-423c-a22d-b7f10e7e2de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:32.589546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063e157-7da6-4ed2-91d0-b054668d38a4 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b0b1656d-35f1-423c-a22d-b7f10e7e2de8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:32.593886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:32.596541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 168/355] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:32.598476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1656d-35f1-423c-a22d-b7f10e7e2de8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.624459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3116c0-ee88-4d7b-bbf8-d94793b1a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.625117 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3116c0-ee88-4d7b-bbf8-d94793b1a944 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.625391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3116c0-ee88-4d7b-bbf8-d94793b1a944 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.625658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3116c0-ee88-4d7b-bbf8-d94793b1a944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.626515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3116c0-ee88-4d7b-bbf8-d94793b1a944 None admin] RBAC: Adding query filter params (role.id=f176776959444eaa8bec7f749a9a1687, user.id=672f7817a4c74ccabaa3aa9bb4580ff8, scope.system=all) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:32.626820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3116c0-ee88-4d7b-bbf8-d94793b1a944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.628410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3116c0-ee88-4d7b-bbf8-d94793b1a944 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.640535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 188/356] 10.222.0.44 () {56 vars in 1308 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/role_assignments?user.id=672f7817a4c74ccabaa3aa9bb4580ff8&scope.system=all&role.id=f176776959444eaa8bec7f749a9a1687 => generated 510 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.641353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3116c0-ee88-4d7b-bbf8-d94793b1a944 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.703476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1656d-35f1-423c-a22d-b7f10e7e2de8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.741834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc47b41-d6aa-45f4-bc58-4784c2c7211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.742732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc47b41-d6aa-45f4-bc58-4784c2c7211b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.743014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc47b41-d6aa-45f4-bc58-4784c2c7211b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.743285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc47b41-d6aa-45f4-bc58-4784c2c7211b None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.744531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc47b41-d6aa-45f4-bc58-4784c2c7211b None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.745991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc47b41-d6aa-45f4-bc58-4784c2c7211b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.747766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 169/357] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.748670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc47b41-d6aa-45f4-bc58-4784c2c7211b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.758926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3116c0-ee88-4d7b-bbf8-d94793b1a944 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.795828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fca370-5764-487b-9b35-489bbb884ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.796495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fca370-5764-487b-9b35-489bbb884ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.796774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fca370-5764-487b-9b35-489bbb884ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.797047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fca370-5764-487b-9b35-489bbb884ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.797878 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fca370-5764-487b-9b35-489bbb884ee5 None admin] RBAC: Adding query filter params (group.id=db2e559a92004ea8891f8a7d00bee836, role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=db8112f1b83d4722a9c6776f739c6c71) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:32.798235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fca370-5764-487b-9b35-489bbb884ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.800385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fca370-5764-487b-9b35-489bbb884ee5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.806614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 189/358] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/role_assignments?group.id=db2e559a92004ea8891f8a7d00bee836&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.808069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6729ad-957f-4ca9-acf2-2189b3ac1f10 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.808355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6729ad-957f-4ca9-acf2-2189b3ac1f10 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.808627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6729ad-957f-4ca9-acf2-2189b3ac1f10 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.810337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 190/359] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:32.811103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6729ad-957f-4ca9-acf2-2189b3ac1f10 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:32.862640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc47b41-d6aa-45f4-bc58-4784c2c7211b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.898855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed917b4-7be7-4d1a-90ef-b0a27bf75f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.899541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed917b4-7be7-4d1a-90ef-b0a27bf75f53 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.899821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed917b4-7be7-4d1a-90ef-b0a27bf75f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.900094 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed917b4-7be7-4d1a-90ef-b0a27bf75f53 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.900849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed917b4-7be7-4d1a-90ef-b0a27bf75f53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:32.901155 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed917b4-7be7-4d1a-90ef-b0a27bf75f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.902592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed917b4-7be7-4d1a-90ef-b0a27bf75f53 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.912568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 170/360] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.913967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dba31-c59e-4113-a1ee-b839004dde1a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.914287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dba31-c59e-4113-a1ee-b839004dde1a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.914559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dba31-c59e-4113-a1ee-b839004dde1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.929206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6729ad-957f-4ca9-acf2-2189b3ac1f10 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:32.932147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-704dba31-c59e-4113-a1ee-b839004dde1a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:32.933341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-704dba31-c59e-4113-a1ee-b839004dde1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:32.966559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48b8be-df60-4c81-a18e-b48685e81656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:32.967213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b8be-df60-4c81-a18e-b48685e81656 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:32.967492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b8be-df60-4c81-a18e-b48685e81656 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:32.967761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b8be-df60-4c81-a18e-b48685e81656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:32.968654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48b8be-df60-4c81-a18e-b48685e81656 None admin] RBAC: Adding query filter params (group.id=db2e559a92004ea8891f8a7d00bee836, role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=db8112f1b83d4722a9c6776f739c6c71) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:32.968969 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48b8be-df60-4c81-a18e-b48685e81656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:32.970545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48b8be-df60-4c81-a18e-b48685e81656 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:32.977126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 191/361] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/role_assignments?group.id=db2e559a92004ea8891f8a7d00bee836&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=638115ca27864c64a0554c5c0913956a => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:32.978016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48b8be-df60-4c81-a18e-b48685e81656 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:33.010084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 171/362] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:33.030670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dba31-c59e-4113-a1ee-b839004dde1a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:33.092609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48b8be-df60-4c81-a18e-b48685e81656 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:33.129967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636967e-c128-4bb9-a071-55da33e5a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:33.130628 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636967e-c128-4bb9-a071-55da33e5a0cb None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.130905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636967e-c128-4bb9-a071-55da33e5a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.131223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636967e-c128-4bb9-a071-55da33e5a0cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.141707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dba31-c59e-4113-a1ee-b839004dde1a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:33.181981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd5989-49eb-43d5-a3e0-3edeb25bdbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:33.182843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd5989-49eb-43d5-a3e0-3edeb25bdbfc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.183116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd5989-49eb-43d5-a3e0-3edeb25bdbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.183386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd5989-49eb-43d5-a3e0-3edeb25bdbfc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.197208 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd5989-49eb-43d5-a3e0-3edeb25bdbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0dfd5989-49eb-43d5-a3e0-3edeb25bdbfc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:33.207998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:33.210275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:33.212475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 172/363] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:33.214098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636967e-c128-4bb9-a071-55da33e5a0cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:33.222085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636967e-c128-4bb9-a071-55da33e5a0cb None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:33.222432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd5989-49eb-43d5-a3e0-3edeb25bdbfc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:33.323333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 192/364] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:33.328839 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd5989-49eb-43d5-a3e0-3edeb25bdbfc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:33.330047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636967e-c128-4bb9-a071-55da33e5a0cb None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:33.364509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34ba9b-6599-49f3-8814-967d91891623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:33.365179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34ba9b-6599-49f3-8814-967d91891623 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.365457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34ba9b-6599-49f3-8814-967d91891623 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.365727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34ba9b-6599-49f3-8814-967d91891623 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.366507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34ba9b-6599-49f3-8814-967d91891623 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:33.366810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34ba9b-6599-49f3-8814-967d91891623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:33.368188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34ba9b-6599-49f3-8814-967d91891623 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:33.376545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 173/365] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:33.382661 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34ba9b-6599-49f3-8814-967d91891623 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:33.430507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636967e-c128-4bb9-a071-55da33e5a0cb None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:33.466922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca381-fcea-44ab-a6e6-0f297de04df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:33.467786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca381-fcea-44ab-a6e6-0f297de04df5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.468056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca381-fcea-44ab-a6e6-0f297de04df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.468321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca381-fcea-44ab-a6e6-0f297de04df5 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.469600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbca381-fcea-44ab-a6e6-0f297de04df5 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:33.471138 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbca381-fcea-44ab-a6e6-0f297de04df5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:33.473232 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 193/366] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:33 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:33.474464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba2f2-4fbc-4a80-afc8-ebe79babb03c None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.474922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba2f2-4fbc-4a80-afc8-ebe79babb03c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.475197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba2f2-4fbc-4a80-afc8-ebe79babb03c None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.481050 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 194/367] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:33.481723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34ba9b-6599-49f3-8814-967d91891623 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:33.482033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ba2f2-4fbc-4a80-afc8-ebe79babb03c None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:33.516973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0b0c0-8049-4f09-bc72-e849677d7de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:33.517666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b0c0-8049-4f09-bc72-e849677d7de1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.518001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b0c0-8049-4f09-bc72-e849677d7de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.518314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b0c0-8049-4f09-bc72-e849677d7de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.588117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0b0c0-8049-4f09-bc72-e849677d7de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:33.589818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0b0c0-8049-4f09-bc72-e849677d7de1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:33.590429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ba2f2-4fbc-4a80-afc8-ebe79babb03c None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:33.630397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e98a9-defc-4cff-8d1e-b933ca7fa210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:33.631260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e98a9-defc-4cff-8d1e-b933ca7fa210 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.631534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e98a9-defc-4cff-8d1e-b933ca7fa210 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.631800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e98a9-defc-4cff-8d1e-b933ca7fa210 None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.633453 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e98a9-defc-4cff-8d1e-b933ca7fa210 None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:33.635288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e98a9-defc-4cff-8d1e-b933ca7fa210 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:33.637616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 195/368] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:33 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:33.638901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1841d-2f49-4bf8-8ac2-fb53a616587b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.639181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1841d-2f49-4bf8-8ac2-fb53a616587b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.639447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1841d-2f49-4bf8-8ac2-fb53a616587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.658748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-5de1841d-2f49-4bf8-8ac2-fb53a616587b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:33.660523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5de1841d-2f49-4bf8-8ac2-fb53a616587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:33.709040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 174/369] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 14:55:33.709675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0b0c0-8049-4f09-bc72-e849677d7de1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:33.751367 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 196/370] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:33.752284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1841d-2f49-4bf8-8ac2-fb53a616587b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:33.811191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0b0c0-8049-4f09-bc72-e849677d7de1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:33.847231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473389a-eb84-494d-b606-e4e27611c60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:33.848219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473389a-eb84-494d-b606-e4e27611c60f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.848676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473389a-eb84-494d-b606-e4e27611c60f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.849118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473389a-eb84-494d-b606-e4e27611c60f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.850210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473389a-eb84-494d-b606-e4e27611c60f None admin] RBAC: Adding query filter params (group.id=db2e559a92004ea8891f8a7d00bee836, role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=da3df20a1f56481987bf9fc24fcac939) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:33.850770 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473389a-eb84-494d-b606-e4e27611c60f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:33.852389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473389a-eb84-494d-b606-e4e27611c60f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:33.858821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 175/371] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:33 2022] GET /identity/v3/role_assignments?group.id=db2e559a92004ea8891f8a7d00bee836&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:33.860013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473389a-eb84-494d-b606-e4e27611c60f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:33.871439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1841d-2f49-4bf8-8ac2-fb53a616587b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:33.907717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc877-1546-402a-a424-3a5a255eda89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:33.908868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc877-1546-402a-a424-3a5a255eda89 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:33.909294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc877-1546-402a-a424-3a5a255eda89 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:33.909728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bc877-1546-402a-a424-3a5a255eda89 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:33.911131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bc877-1546-402a-a424-3a5a255eda89 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:33.912733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515bc877-1546-402a-a424-3a5a255eda89 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:33.914652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 197/372] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:33 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:33.920360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc877-1546-402a-a424-3a5a255eda89 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:34.065439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bc877-1546-402a-a424-3a5a255eda89 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:34.102816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6959f4-1705-4259-aa80-b32a955dd2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:34.103933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6959f4-1705-4259-aa80-b32a955dd2dc None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:34.104358 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6959f4-1705-4259-aa80-b32a955dd2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:34.104798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6959f4-1705-4259-aa80-b32a955dd2dc None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:34.106222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6959f4-1705-4259-aa80-b32a955dd2dc None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:34.107111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473389a-eb84-494d-b606-e4e27611c60f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:34.107997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6959f4-1705-4259-aa80-b32a955dd2dc None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:34.109815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 198/373] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:33 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:34.116252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6959f4-1705-4259-aa80-b32a955dd2dc None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:34.173817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ea743-e5a7-46b8-a5b4-803adb5e1e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:34.175344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ea743-e5a7-46b8-a5b4-803adb5e1e22 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:34.175684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ea743-e5a7-46b8-a5b4-803adb5e1e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:34.176057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ea743-e5a7-46b8-a5b4-803adb5e1e22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:34.187194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ea743-e5a7-46b8-a5b4-803adb5e1e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-5e8ea743-e5a7-46b8-a5b4-803adb5e1e22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:34.197323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:34.198273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:34.199072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:34.201423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 176/374] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:55:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:34.207198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ea743-e5a7-46b8-a5b4-803adb5e1e22 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:34.227072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6959f4-1705-4259-aa80-b32a955dd2dc None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:34.280751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbdc22-1202-42d6-bc5c-27f37f79d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:34.282563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbdc22-1202-42d6-bc5c-27f37f79d77d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:34.283187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbdc22-1202-42d6-bc5c-27f37f79d77d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:34.284439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbdc22-1202-42d6-bc5c-27f37f79d77d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:34.285647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbdc22-1202-42d6-bc5c-27f37f79d77d None admin] RBAC: Adding query filter params (group.id=db2e559a92004ea8891f8a7d00bee836, role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=da3df20a1f56481987bf9fc24fcac939) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:34.287332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbdc22-1202-42d6-bc5c-27f37f79d77d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:34.288992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbdc22-1202-42d6-bc5c-27f37f79d77d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:34.301406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 199/375] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:34 2022] GET /identity/v3/role_assignments?group.id=db2e559a92004ea8891f8a7d00bee836&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=638115ca27864c64a0554c5c0913956a => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:34.349668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ea743-e5a7-46b8-a5b4-803adb5e1e22 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:34.387350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d264089-a8e4-4d47-9df8-7aad0698ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:34.388428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d264089-a8e4-4d47-9df8-7aad0698ae8a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:34.388941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d264089-a8e4-4d47-9df8-7aad0698ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:34.389418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d264089-a8e4-4d47-9df8-7aad0698ae8a None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:34.390419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d264089-a8e4-4d47-9df8-7aad0698ae8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:34.390944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d264089-a8e4-4d47-9df8-7aad0698ae8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:34.392506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d264089-a8e4-4d47-9df8-7aad0698ae8a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:34.403695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 177/376] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:34.410015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbdc22-1202-42d6-bc5c-27f37f79d77d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:34.535253 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbdc22-1202-42d6-bc5c-27f37f79d77d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:34.574300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a90b76-cc32-4d67-8e7b-43296dc8e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:34.575304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a90b76-cc32-4d67-8e7b-43296dc8e139 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:34.575798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a90b76-cc32-4d67-8e7b-43296dc8e139 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:34.576262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a90b76-cc32-4d67-8e7b-43296dc8e139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:34.645229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a90b76-cc32-4d67-8e7b-43296dc8e139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:34.647199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a90b76-cc32-4d67-8e7b-43296dc8e139 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:34.755626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 200/377] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 14:55:34.761442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d264089-a8e4-4d47-9df8-7aad0698ae8a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:34.889461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d264089-a8e4-4d47-9df8-7aad0698ae8a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:34.924667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbf8e-38bd-42b3-a68e-b63ecac29e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:34.925530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbf8e-38bd-42b3-a68e-b63ecac29e02 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:34.925808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbf8e-38bd-42b3-a68e-b63ecac29e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:34.926094 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbf8e-38bd-42b3-a68e-b63ecac29e02 None admin] PATH_INFO: `/v3/projects/205b1267d8204d608304e6a78a0e361f` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:34.927293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfbf8e-38bd-42b3-a68e-b63ecac29e02 None admin] RBAC: Authorizing `identity:get_project(project_id=205b1267d8204d608304e6a78a0e361f)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:34.928740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfbf8e-38bd-42b3-a68e-b63ecac29e02 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:34.930773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 178/378] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:34 2022] GET /identity/v3/projects/205b1267d8204d608304e6a78a0e361f => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:34.936029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a90b76-cc32-4d67-8e7b-43296dc8e139 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:35.090919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a90b76-cc32-4d67-8e7b-43296dc8e139 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:35.129975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52406f4e-e73e-4bbe-bd3e-513002d09f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:35.131228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52406f4e-e73e-4bbe-bd3e-513002d09f77 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:35.131706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52406f4e-e73e-4bbe-bd3e-513002d09f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:35.132175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52406f4e-e73e-4bbe-bd3e-513002d09f77 None admin] PATH_INFO: `/v3/groups/e5660cab30f248d1be93bc6e1d55b4b5` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:35.141201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52406f4e-e73e-4bbe-bd3e-513002d09f77 None admin] RBAC: Authorizing `identity:get_group(group_id=e5660cab30f248d1be93bc6e1d55b4b5)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:35.142938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52406f4e-e73e-4bbe-bd3e-513002d09f77 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:35.144910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 201/379] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:34 2022] GET /identity/v3/groups/e5660cab30f248d1be93bc6e1d55b4b5 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:35.150855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbf8e-38bd-42b3-a68e-b63ecac29e02 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:35.286341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbf8e-38bd-42b3-a68e-b63ecac29e02 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:35.320231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc49a8f-7e5d-487b-b6fd-8e2af384ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:35.320951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49a8f-7e5d-487b-b6fd-8e2af384ac31 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:35.321232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49a8f-7e5d-487b-b6fd-8e2af384ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:35.321506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49a8f-7e5d-487b-b6fd-8e2af384ac31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:35.322407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49a8f-7e5d-487b-b6fd-8e2af384ac31 None admin] RBAC: Adding query filter params (group.id=e5660cab30f248d1be93bc6e1d55b4b5, role.id=042169a166e14a80beac826291ceaf73, scope.project.id=205b1267d8204d608304e6a78a0e361f) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:35.322718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49a8f-7e5d-487b-b6fd-8e2af384ac31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:35.324136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc49a8f-7e5d-487b-b6fd-8e2af384ac31 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:35.334603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 179/380] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:35 2022] GET /identity/v3/role_assignments?group.id=e5660cab30f248d1be93bc6e1d55b4b5&scope.project.id=205b1267d8204d608304e6a78a0e361f&role.id=042169a166e14a80beac826291ceaf73 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:36.059543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601f95-1773-480d-9854-24c2b35e16b6 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.060510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601f95-1773-480d-9854-24c2b35e16b6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.061000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601f95-1773-480d-9854-24c2b35e16b6 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.062628 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 202/381] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:36.074210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bc650-cf14-4974-bebb-ab1614188da7 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.075138 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bc650-cf14-4974-bebb-ab1614188da7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.075614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bc650-cf14-4974-bebb-ab1614188da7 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.077206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 180/382] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:36.084705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f2adf-dca7-4aba-9daf-b7a16c24c7d7 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.085233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f2adf-dca7-4aba-9daf-b7a16c24c7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.085705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f2adf-dca7-4aba-9daf-b7a16c24c7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.088871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31a7db-2b1e-4adc-ae29-7a87368b5d3c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.090343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31a7db-2b1e-4adc-ae29-7a87368b5d3c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.091874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31a7db-2b1e-4adc-ae29-7a87368b5d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.119197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-478f2adf-dca7-4aba-9daf-b7a16c24c7d7 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:36.120893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-478f2adf-dca7-4aba-9daf-b7a16c24c7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:36.126957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fc31a7db-2b1e-4adc-ae29-7a87368b5d3c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:36.134556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fc31a7db-2b1e-4adc-ae29-7a87368b5d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:36.250135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 203/383] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:36.256384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 181/384] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:36.283513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f2adf-dca7-4aba-9daf-b7a16c24c7d7 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:36.284266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31a7db-2b1e-4adc-ae29-7a87368b5d3c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:36.457281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f2adf-dca7-4aba-9daf-b7a16c24c7d7 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:36.471639 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31a7db-2b1e-4adc-ae29-7a87368b5d3c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:36.525022 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487d6e7-75d8-43fd-aeb9-aaae451f38bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:36.525825 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487d6e7-75d8-43fd-aeb9-aaae451f38bd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.526132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487d6e7-75d8-43fd-aeb9-aaae451f38bd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.526412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487d6e7-75d8-43fd-aeb9-aaae451f38bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.532957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6990ac2-b1f9-4631-b4ad-35b5759cf856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:36.534325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990ac2-b1f9-4631-b4ad-35b5759cf856 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.534603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990ac2-b1f9-4631-b4ad-35b5759cf856 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.534874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990ac2-b1f9-4631-b4ad-35b5759cf856 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.537740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487d6e7-75d8-43fd-aeb9-aaae451f38bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0487d6e7-75d8-43fd-aeb9-aaae451f38bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:36.546110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:36.547266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:36.548274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:36.550829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 182/385] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:36.556209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487d6e7-75d8-43fd-aeb9-aaae451f38bd None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:36.562764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6990ac2-b1f9-4631-b4ad-35b5759cf856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c6990ac2-b1f9-4631-b4ad-35b5759cf856 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:36.571059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:36.572129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:36.573044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:36.582247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 204/386] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:36.599507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6990ac2-b1f9-4631-b4ad-35b5759cf856 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:36.672375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487d6e7-75d8-43fd-aeb9-aaae451f38bd None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:36.707867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4ecb-8cd6-4d86-8291-080e107c3537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:36.708777 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4ecb-8cd6-4d86-8291-080e107c3537 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.709264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4ecb-8cd6-4d86-8291-080e107c3537 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.709682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4ecb-8cd6-4d86-8291-080e107c3537 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.710650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4ecb-8cd6-4d86-8291-080e107c3537 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:36.711389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4ecb-8cd6-4d86-8291-080e107c3537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:36.712924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4ecb-8cd6-4d86-8291-080e107c3537 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:36.721983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 183/387] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:36.727369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4ecb-8cd6-4d86-8291-080e107c3537 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:36.805035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6990ac2-b1f9-4631-b4ad-35b5759cf856 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:36.841677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef026fa-6267-4fe5-b378-17f5b8166129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:36.842740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef026fa-6267-4fe5-b378-17f5b8166129 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.843250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef026fa-6267-4fe5-b378-17f5b8166129 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.843731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef026fa-6267-4fe5-b378-17f5b8166129 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.844683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef026fa-6267-4fe5-b378-17f5b8166129 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:36.845213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef026fa-6267-4fe5-b378-17f5b8166129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:36.846874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef026fa-6267-4fe5-b378-17f5b8166129 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:36.847241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4ecb-8cd6-4d86-8291-080e107c3537 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:36.855747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 205/388] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:36.857303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c59a72-136c-4f2c-bb6f-ba3ea0ea7d97 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.857822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c59a72-136c-4f2c-bb6f-ba3ea0ea7d97 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.858361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c59a72-136c-4f2c-bb6f-ba3ea0ea7d97 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.860078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 206/389] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:36.866015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3dfcf-7e96-49fe-a253-0e3365c70c9e None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.866590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3dfcf-7e96-49fe-a253-0e3365c70c9e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.867093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3dfcf-7e96-49fe-a253-0e3365c70c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.886493 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-fbd3dfcf-7e96-49fe-a253-0e3365c70c9e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:36.887971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fbd3dfcf-7e96-49fe-a253-0e3365c70c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:36.893971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096f77-9087-4bfe-89bc-aff64fa96178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:36.894863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096f77-9087-4bfe-89bc-aff64fa96178 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:36.895146 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096f77-9087-4bfe-89bc-aff64fa96178 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:36.895421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe096f77-9087-4bfe-89bc-aff64fa96178 None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:36.897090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe096f77-9087-4bfe-89bc-aff64fa96178 None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:36.898913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe096f77-9087-4bfe-89bc-aff64fa96178 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:36.901941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 184/390] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:36 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:36.903080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096f77-9087-4bfe-89bc-aff64fa96178 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:36.975840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 207/391] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:36.977026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3dfcf-7e96-49fe-a253-0e3365c70c9e None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:37.051239 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe096f77-9087-4bfe-89bc-aff64fa96178 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:37.093119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2e368-ead4-4f20-84a8-74a2be1d54b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:37.093989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e368-ead4-4f20-84a8-74a2be1d54b1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.094315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e368-ead4-4f20-84a8-74a2be1d54b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.094518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3dfcf-7e96-49fe-a253-0e3365c70c9e None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:37.094881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e368-ead4-4f20-84a8-74a2be1d54b1 None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.095936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2e368-ead4-4f20-84a8-74a2be1d54b1 None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:37.097392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2e368-ead4-4f20-84a8-74a2be1d54b1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:37.099095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 185/392] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:36 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:37.099979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2e368-ead4-4f20-84a8-74a2be1d54b1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:37.132343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049855-8cb3-45e7-affa-2fe10d11cf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:37.133198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049855-8cb3-45e7-affa-2fe10d11cf99 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.133477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049855-8cb3-45e7-affa-2fe10d11cf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.133750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049855-8cb3-45e7-affa-2fe10d11cf99 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.134999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df049855-8cb3-45e7-affa-2fe10d11cf99 None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:37.136457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df049855-8cb3-45e7-affa-2fe10d11cf99 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:37.138189 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 208/393] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:36 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:37.139005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049855-8cb3-45e7-affa-2fe10d11cf99 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:37.218480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2e368-ead4-4f20-84a8-74a2be1d54b1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:37.257534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049855-8cb3-45e7-affa-2fe10d11cf99 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:37.259470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f17240-cb7d-42ae-80ca-c207cd67890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:37.260344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f17240-cb7d-42ae-80ca-c207cd67890c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.261775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f17240-cb7d-42ae-80ca-c207cd67890c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.261775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f17240-cb7d-42ae-80ca-c207cd67890c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.281548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f17240-cb7d-42ae-80ca-c207cd67890c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-33f17240-cb7d-42ae-80ca-c207cd67890c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:37.297894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:37.299447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:37.300250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 186/394] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:37.300910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f17240-cb7d-42ae-80ca-c207cd67890c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:37.318465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a4226-3ec4-4888-9a92-c7b304034afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:37.319720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a4226-3ec4-4888-9a92-c7b304034afb None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.320208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a4226-3ec4-4888-9a92-c7b304034afb None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.320687 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a4226-3ec4-4888-9a92-c7b304034afb None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.323491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a4226-3ec4-4888-9a92-c7b304034afb None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:37.326422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a4226-3ec4-4888-9a92-c7b304034afb None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:37.329334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 209/395] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:37 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:37.330927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a6aa8-7701-4448-9d1b-557ee319fb61 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.331452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a6aa8-7701-4448-9d1b-557ee319fb61 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.331950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a6aa8-7701-4448-9d1b-557ee319fb61 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.333386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 210/396] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:37.334355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a6aa8-7701-4448-9d1b-557ee319fb61 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:37.457901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f17240-cb7d-42ae-80ca-c207cd67890c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:37.482808 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a6aa8-7701-4448-9d1b-557ee319fb61 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:37.512419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eb241-fd9b-42b7-9a73-a7edb9224ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:37.513536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb241-fd9b-42b7-9a73-a7edb9224ff8 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.514736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb241-fd9b-42b7-9a73-a7edb9224ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.515252 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb241-fd9b-42b7-9a73-a7edb9224ff8 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71/groups/db2e559a92004ea8891f8a7d00bee836/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.517537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb241-fd9b-42b7-9a73-a7edb9224ff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=db8112f1b83d4722a9c6776f739c6c71, group_id=db2e559a92004ea8891f8a7d00bee836, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:37.519105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb241-fd9b-42b7-9a73-a7edb9224ff8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:37.530542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29f4bc-3fff-4015-a602-48e912a319cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:37.539120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29f4bc-3fff-4015-a602-48e912a319cc None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.539120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29f4bc-3fff-4015-a602-48e912a319cc None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.539120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29f4bc-3fff-4015-a602-48e912a319cc None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.539120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29f4bc-3fff-4015-a602-48e912a319cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:37.539120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29f4bc-3fff-4015-a602-48e912a319cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:37.539120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29f4bc-3fff-4015-a602-48e912a319cc None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:37.544083 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 211/397] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:37.545199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29f4bc-3fff-4015-a602-48e912a319cc None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:37.596603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 187/398] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 16 14:55:37 2022] PUT /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71/groups/db2e559a92004ea8891f8a7d00bee836/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:55:37.598365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10d92-44f6-4473-ae20-c7eede714d04 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.598884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10d92-44f6-4473-ae20-c7eede714d04 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.599167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10d92-44f6-4473-ae20-c7eede714d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.636622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-87d10d92-44f6-4473-ae20-c7eede714d04 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:37.639954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-87d10d92-44f6-4473-ae20-c7eede714d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:37.695446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29f4bc-3fff-4015-a602-48e912a319cc None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:37.734918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 188/399] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:37.742077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10d92-44f6-4473-ae20-c7eede714d04 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:37.742263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3da3b-d6b2-4a09-a442-ae5d5f062921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:37.742263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3da3b-d6b2-4a09-a442-ae5d5f062921 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.742263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3da3b-d6b2-4a09-a442-ae5d5f062921 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.742263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3da3b-d6b2-4a09-a442-ae5d5f062921 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71/groups/db2e559a92004ea8891f8a7d00bee836/roles/638115ca27864c64a0554c5c0913956a` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.744568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3da3b-d6b2-4a09-a442-ae5d5f062921 None admin] RBAC: Authorizing `identity:create_grant(project_id=db8112f1b83d4722a9c6776f739c6c71, group_id=db2e559a92004ea8891f8a7d00bee836, role_id=638115ca27864c64a0554c5c0913956a)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:37.746463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3da3b-d6b2-4a09-a442-ae5d5f062921 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:37.824303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 212/400] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 16 14:55:37 2022] PUT /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71/groups/db2e559a92004ea8891f8a7d00bee836/roles/638115ca27864c64a0554c5c0913956a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:55:37.824945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3da3b-d6b2-4a09-a442-ae5d5f062921 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:37.872727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10d92-44f6-4473-ae20-c7eede714d04 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:37.916114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b2c5e-4225-4a5e-af3c-925ab20037c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:37.917244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b2c5e-4225-4a5e-af3c-925ab20037c1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.917674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b2c5e-4225-4a5e-af3c-925ab20037c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.918151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b2c5e-4225-4a5e-af3c-925ab20037c1 None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:37.919609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b2c5e-4225-4a5e-af3c-925ab20037c1 None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:37.921292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b2c5e-4225-4a5e-af3c-925ab20037c1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:37.923362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 189/401] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:37 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:37.929305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b2c5e-4225-4a5e-af3c-925ab20037c1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:37.949587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3da3b-d6b2-4a09-a442-ae5d5f062921 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:37.987826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28061103-b899-4fb2-9cbb-15d33eeb1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:37.988690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061103-b899-4fb2-9cbb-15d33eeb1a3f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:37.988980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061103-b899-4fb2-9cbb-15d33eeb1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:37.989252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061103-b899-4fb2-9cbb-15d33eeb1a3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.002695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28061103-b899-4fb2-9cbb-15d33eeb1a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-28061103-b899-4fb2-9cbb-15d33eeb1a3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:38.012306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:38.013271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:38.014526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 213/402] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:38.020003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28061103-b899-4fb2-9cbb-15d33eeb1a3f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:38.083111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b2c5e-4225-4a5e-af3c-925ab20037c1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:38.140938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28061103-b899-4fb2-9cbb-15d33eeb1a3f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:38.142829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2b28-a600-4c19-9d96-d27f33e2e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:38.143712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2b28-a600-4c19-9d96-d27f33e2e731 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.143989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2b28-a600-4c19-9d96-d27f33e2e731 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.144258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2b28-a600-4c19-9d96-d27f33e2e731 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.145502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e2b28-a600-4c19-9d96-d27f33e2e731 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:38.146969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e2b28-a600-4c19-9d96-d27f33e2e731 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:38.148960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 190/403] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:37 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:38.154513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2b28-a600-4c19-9d96-d27f33e2e731 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:38.176775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4bf7-8cf7-4f57-870a-118eccd07708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:38.177854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4bf7-8cf7-4f57-870a-118eccd07708 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.179965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4bf7-8cf7-4f57-870a-118eccd07708 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.180467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe4bf7-8cf7-4f57-870a-118eccd07708 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.181440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4bf7-8cf7-4f57-870a-118eccd07708 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:38.182011 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4bf7-8cf7-4f57-870a-118eccd07708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:38.183648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe4bf7-8cf7-4f57-870a-118eccd07708 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:38.194946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 214/404] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:38.201842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4bf7-8cf7-4f57-870a-118eccd07708 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:38.277086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2b28-a600-4c19-9d96-d27f33e2e731 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:38.315462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0b02c-26bc-498b-8961-1d65ac79f25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:38.316356 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b02c-26bc-498b-8961-1d65ac79f25c None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.316690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b02c-26bc-498b-8961-1d65ac79f25c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.316966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b02c-26bc-498b-8961-1d65ac79f25c None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939/groups/db2e559a92004ea8891f8a7d00bee836/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.319626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0b02c-26bc-498b-8961-1d65ac79f25c None admin] RBAC: Authorizing `identity:create_grant(project_id=da3df20a1f56481987bf9fc24fcac939, group_id=db2e559a92004ea8891f8a7d00bee836, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:38.321063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0b02c-26bc-498b-8961-1d65ac79f25c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:38.326144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe4bf7-8cf7-4f57-870a-118eccd07708 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:38.360266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725254-4549-49ca-876f-ab77c541a9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:38.361101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725254-4549-49ca-876f-ab77c541a9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.361945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725254-4549-49ca-876f-ab77c541a9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.362251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725254-4549-49ca-876f-ab77c541a9f7 None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.363440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61725254-4549-49ca-876f-ab77c541a9f7 None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:38.364955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61725254-4549-49ca-876f-ab77c541a9f7 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:38.366934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 215/405] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:38 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:38.368188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b76cef-413b-4777-b5ce-bf3b2f4ab4e7 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.369027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b76cef-413b-4777-b5ce-bf3b2f4ab4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.369315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b76cef-413b-4777-b5ce-bf3b2f4ab4e7 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.371177 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 216/406] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:38.374873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b76cef-413b-4777-b5ce-bf3b2f4ab4e7 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:38.456979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 191/407] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 16 14:55:38 2022] PUT /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939/groups/db2e559a92004ea8891f8a7d00bee836/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:55:38.458519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f2ade-9f07-4ec2-9408-3bf3673600d1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.458808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f2ade-9f07-4ec2-9408-3bf3673600d1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.459087 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f2ade-9f07-4ec2-9408-3bf3673600d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.478471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-174f2ade-9f07-4ec2-9408-3bf3673600d1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:38.479755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-174f2ade-9f07-4ec2-9408-3bf3673600d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:38.493595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b76cef-413b-4777-b5ce-bf3b2f4ab4e7 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:38.531252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e90ca6-1e2e-4393-b0bc-3cb3246e06fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:38.532136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e90ca6-1e2e-4393-b0bc-3cb3246e06fb None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.532416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e90ca6-1e2e-4393-b0bc-3cb3246e06fb None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.532690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e90ca6-1e2e-4393-b0bc-3cb3246e06fb None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.535129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e90ca6-1e2e-4393-b0bc-3cb3246e06fb None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:38.536587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e90ca6-1e2e-4393-b0bc-3cb3246e06fb None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:38.538382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 217/408] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:38 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:38.548203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e90ca6-1e2e-4393-b0bc-3cb3246e06fb None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:38.572127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 192/409] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:38.614191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f2ade-9f07-4ec2-9408-3bf3673600d1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:38.718795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e90ca6-1e2e-4393-b0bc-3cb3246e06fb None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:38.732134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f2ade-9f07-4ec2-9408-3bf3673600d1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:38.764499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df501e-7bf9-4234-a0ae-6c4793e2c71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:38.765552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df501e-7bf9-4234-a0ae-6c4793e2c71d None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.765828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df501e-7bf9-4234-a0ae-6c4793e2c71d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.766417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df501e-7bf9-4234-a0ae-6c4793e2c71d None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939/groups/db2e559a92004ea8891f8a7d00bee836/roles/638115ca27864c64a0554c5c0913956a` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.771118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df501e-7bf9-4234-a0ae-6c4793e2c71d None admin] RBAC: Authorizing `identity:create_grant(project_id=da3df20a1f56481987bf9fc24fcac939, group_id=db2e559a92004ea8891f8a7d00bee836, role_id=638115ca27864c64a0554c5c0913956a)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:38.772580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df501e-7bf9-4234-a0ae-6c4793e2c71d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:38.779359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40004c-caac-41d7-950e-61fda75f381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:38.780166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40004c-caac-41d7-950e-61fda75f381d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.780446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40004c-caac-41d7-950e-61fda75f381d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.780724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40004c-caac-41d7-950e-61fda75f381d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.793149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40004c-caac-41d7-950e-61fda75f381d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ee40004c-caac-41d7-950e-61fda75f381d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:38.801533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:38.802648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:38.803724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 193/410] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:55:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:38.808558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40004c-caac-41d7-950e-61fda75f381d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:38.848468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 218/411] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 16 14:55:38 2022] PUT /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939/groups/db2e559a92004ea8891f8a7d00bee836/roles/638115ca27864c64a0554c5c0913956a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:55:38.925459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40004c-caac-41d7-950e-61fda75f381d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:38.967540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacf510-510a-4c59-b23a-d3a14665ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:38.968314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacf510-510a-4c59-b23a-d3a14665ec48 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:38.968617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacf510-510a-4c59-b23a-d3a14665ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:38.968818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacf510-510a-4c59-b23a-d3a14665ec48 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:38.969577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacf510-510a-4c59-b23a-d3a14665ec48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:38.969892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacf510-510a-4c59-b23a-d3a14665ec48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:38.971949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacf510-510a-4c59-b23a-d3a14665ec48 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:38.981391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 194/412] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:38.987243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df501e-7bf9-4234-a0ae-6c4793e2c71d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:39.120863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df501e-7bf9-4234-a0ae-6c4793e2c71d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:39.161364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9429a-d9ae-4960-acda-1930dcd7603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:39.162261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9429a-d9ae-4960-acda-1930dcd7603f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:39.162545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9429a-d9ae-4960-acda-1930dcd7603f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:39.162817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9429a-d9ae-4960-acda-1930dcd7603f None admin] PATH_INFO: `/v3/groups/e5660cab30f248d1be93bc6e1d55b4b5` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:39.164016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9429a-d9ae-4960-acda-1930dcd7603f None admin] RBAC: Authorizing `identity:get_group(group_id=e5660cab30f248d1be93bc6e1d55b4b5)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:39.165459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9429a-d9ae-4960-acda-1930dcd7603f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:39.167423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 219/413] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:38 2022] GET /identity/v3/groups/e5660cab30f248d1be93bc6e1d55b4b5 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:39.172705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacf510-510a-4c59-b23a-d3a14665ec48 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:39.288855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacf510-510a-4c59-b23a-d3a14665ec48 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:39.325680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e630fa-9e80-402d-9f79-44e003ab74d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:39.326916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e630fa-9e80-402d-9f79-44e003ab74d2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:39.327403 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e630fa-9e80-402d-9f79-44e003ab74d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:39.327895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e630fa-9e80-402d-9f79-44e003ab74d2 None admin] PATH_INFO: `/v3/projects/205b1267d8204d608304e6a78a0e361f` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:39.329301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e630fa-9e80-402d-9f79-44e003ab74d2 None admin] RBAC: Authorizing `identity:get_project(project_id=205b1267d8204d608304e6a78a0e361f)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:39.330981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e630fa-9e80-402d-9f79-44e003ab74d2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:39.333219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 195/414] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:39 2022] GET /identity/v3/projects/205b1267d8204d608304e6a78a0e361f => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:39.339056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9429a-d9ae-4960-acda-1930dcd7603f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:39.441598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9429a-d9ae-4960-acda-1930dcd7603f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:39.475247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041e56b-6473-47ba-9a0f-e129a8732483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:39.476140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e56b-6473-47ba-9a0f-e129a8732483 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:39.476419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e56b-6473-47ba-9a0f-e129a8732483 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:39.476691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e56b-6473-47ba-9a0f-e129a8732483 None admin] PATH_INFO: `/v3/projects/205b1267d8204d608304e6a78a0e361f/groups/e5660cab30f248d1be93bc6e1d55b4b5/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:39.478707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041e56b-6473-47ba-9a0f-e129a8732483 None admin] RBAC: Authorizing `identity:create_grant(project_id=205b1267d8204d608304e6a78a0e361f, group_id=e5660cab30f248d1be93bc6e1d55b4b5, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:39.480148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041e56b-6473-47ba-9a0f-e129a8732483 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:39.558220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 220/415] 10.222.0.44 () {58 vars in 1442 bytes} [Mon May 16 14:55:39 2022] PUT /identity/v3/projects/205b1267d8204d608304e6a78a0e361f/groups/e5660cab30f248d1be93bc6e1d55b4b5/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:55:40.590481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e181442-419a-4988-b155-5ad90c0c1780 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:40.590995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e181442-419a-4988-b155-5ad90c0c1780 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:40.591098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e181442-419a-4988-b155-5ad90c0c1780 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:40.592685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 196/416] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:40.597674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b436-79c7-4e01-b2fc-ab494af18f13 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:40.598084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b436-79c7-4e01-b2fc-ab494af18f13 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:40.598291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b436-79c7-4e01-b2fc-ab494af18f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:40.616212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8552b436-79c7-4e01-b2fc-ab494af18f13 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:40.617448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8552b436-79c7-4e01-b2fc-ab494af18f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:40.684175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 221/417] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:40.718634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e181442-419a-4988-b155-5ad90c0c1780 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:40.811154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ca7f-ab6a-446e-a8fd-b46a7838fcec None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:40.811433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ca7f-ab6a-446e-a8fd-b46a7838fcec None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:40.811894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ca7f-ab6a-446e-a8fd-b46a7838fcec None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:40.813420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 222/418] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:40.827572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9286bd-007a-4b27-a692-29512d487755 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:40.828050 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9286bd-007a-4b27-a692-29512d487755 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:40.828479 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9286bd-007a-4b27-a692-29512d487755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:40.838157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e181442-419a-4988-b155-5ad90c0c1780 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:40.867176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-bc9286bd-007a-4b27-a692-29512d487755 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:40.868386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bc9286bd-007a-4b27-a692-29512d487755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:40.885281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739b587-f3fc-4edb-9a8a-ab7ae27de9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:40.886102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739b587-f3fc-4edb-9a8a-ab7ae27de9bb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:40.886413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739b587-f3fc-4edb-9a8a-ab7ae27de9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:40.886687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739b587-f3fc-4edb-9a8a-ab7ae27de9bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:40.909389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739b587-f3fc-4edb-9a8a-ab7ae27de9bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-5739b587-f3fc-4edb-9a8a-ab7ae27de9bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:40.917128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:40.918183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:40.918990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:40.926405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 197/419] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:40.927246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739b587-f3fc-4edb-9a8a-ab7ae27de9bb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:40.934442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 223/420] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:40.958302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9286bd-007a-4b27-a692-29512d487755 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:41.054770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9286bd-007a-4b27-a692-29512d487755 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:41.112605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce531f-721f-4394-a4fe-104341ab33e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:41.113479 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce531f-721f-4394-a4fe-104341ab33e3 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.113754 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce531f-721f-4394-a4fe-104341ab33e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.114067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce531f-721f-4394-a4fe-104341ab33e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.124623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce531f-721f-4394-a4fe-104341ab33e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-2bce531f-721f-4394-a4fe-104341ab33e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:41.135081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:41.136078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:41.136873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 224/421] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:41.143969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739b587-f3fc-4edb-9a8a-ab7ae27de9bb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:41.146186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce531f-721f-4394-a4fe-104341ab33e3 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:41.222499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37958c3a-19d1-4da1-ab80-7cfb5e6800e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:41.223223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37958c3a-19d1-4da1-ab80-7cfb5e6800e5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.223503 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37958c3a-19d1-4da1-ab80-7cfb5e6800e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.223773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37958c3a-19d1-4da1-ab80-7cfb5e6800e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.224521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37958c3a-19d1-4da1-ab80-7cfb5e6800e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:41.224823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37958c3a-19d1-4da1-ab80-7cfb5e6800e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:41.226223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37958c3a-19d1-4da1-ab80-7cfb5e6800e5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:41.247044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 198/422] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:41.252986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37958c3a-19d1-4da1-ab80-7cfb5e6800e5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:41.333179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce531f-721f-4394-a4fe-104341ab33e3 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:41.383269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c095b1-56bd-4b24-a18e-554eb10916e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:41.383850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c095b1-56bd-4b24-a18e-554eb10916e6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.384133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c095b1-56bd-4b24-a18e-554eb10916e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.384387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c095b1-56bd-4b24-a18e-554eb10916e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.385129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c095b1-56bd-4b24-a18e-554eb10916e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:41.385424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c095b1-56bd-4b24-a18e-554eb10916e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:41.390495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c095b1-56bd-4b24-a18e-554eb10916e6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:41.406591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 225/423] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:41.408551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe14c1-5869-4111-a764-c936e8eba953 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.409187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe14c1-5869-4111-a764-c936e8eba953 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.409990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe14c1-5869-4111-a764-c936e8eba953 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.411913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 226/424] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:41.413277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe14c1-5869-4111-a764-c936e8eba953 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:41.422531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37958c3a-19d1-4da1-ab80-7cfb5e6800e5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:41.459085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8e1d-0039-420e-9313-422571f0fa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:41.459757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8e1d-0039-420e-9313-422571f0fa0f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.460036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8e1d-0039-420e-9313-422571f0fa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.460306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8e1d-0039-420e-9313-422571f0fa0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.534826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe14c1-5869-4111-a764-c936e8eba953 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:41.540352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a8e1d-0039-420e-9313-422571f0fa0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:41.542519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a8e1d-0039-420e-9313-422571f0fa0f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:41.567931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8890c-ca47-4921-abe7-0e1e203392a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:41.568573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8890c-ca47-4921-abe7-0e1e203392a4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.568851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8890c-ca47-4921-abe7-0e1e203392a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.569122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8890c-ca47-4921-abe7-0e1e203392a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.635283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8890c-ca47-4921-abe7-0e1e203392a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:41.636650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8890c-ca47-4921-abe7-0e1e203392a4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:41.662232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 199/425] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:41.662232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e22036-3a44-4779-a296-514d548455e3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.662826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e22036-3a44-4779-a296-514d548455e3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.662826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e22036-3a44-4779-a296-514d548455e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.678264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c5e22036-3a44-4779-a296-514d548455e3 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:41.679463 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c5e22036-3a44-4779-a296-514d548455e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:41.743780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 227/426] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:41.747776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd639d0a-0f95-48d4-ad55-8aee43f2e2fe None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.748187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 200/427] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:41.748726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd639d0a-0f95-48d4-ad55-8aee43f2e2fe None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.749167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd639d0a-0f95-48d4-ad55-8aee43f2e2fe None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.750931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e22036-3a44-4779-a296-514d548455e3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:41.754809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 228/428] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:41.755574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd639d0a-0f95-48d4-ad55-8aee43f2e2fe None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:41.853330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e22036-3a44-4779-a296-514d548455e3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:41.857886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd639d0a-0f95-48d4-ad55-8aee43f2e2fe None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:41.886978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbe47f-8374-4d9b-a1af-69ea570ea6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:41.887853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe47f-8374-4d9b-a1af-69ea570ea6fd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.888139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe47f-8374-4d9b-a1af-69ea570ea6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.888435 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe47f-8374-4d9b-a1af-69ea570ea6fd None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.889609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe47f-8374-4d9b-a1af-69ea570ea6fd None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:41.890496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e5962-ef2a-4f53-ac7c-30cd9fb0e404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:41.891090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe47f-8374-4d9b-a1af-69ea570ea6fd None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:41.891347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5962-ef2a-4f53-ac7c-30cd9fb0e404 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.891627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5962-ef2a-4f53-ac7c-30cd9fb0e404 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.891897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e5962-ef2a-4f53-ac7c-30cd9fb0e404 None admin] PATH_INFO: `/v3/projects/db8112f1b83d4722a9c6776f739c6c71` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.897892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 201/429] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:41 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:41.898029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e5962-ef2a-4f53-ac7c-30cd9fb0e404 None admin] RBAC: Authorizing `identity:get_project(project_id=db8112f1b83d4722a9c6776f739c6c71)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:41.898159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b237-fcf1-4f07-abb2-889dfd794b93 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:41.898159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b237-fcf1-4f07-abb2-889dfd794b93 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:41.898288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e5962-ef2a-4f53-ac7c-30cd9fb0e404 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:41.898354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b237-fcf1-4f07-abb2-889dfd794b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:41.898419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 229/430] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:41 2022] GET /identity/v3/projects/db8112f1b83d4722a9c6776f739c6c71 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:41.898419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e5962-ef2a-4f53-ac7c-30cd9fb0e404 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:41.916278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5629b237-fcf1-4f07-abb2-889dfd794b93 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:41.917473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5629b237-fcf1-4f07-abb2-889dfd794b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:41.981568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 202/431] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:41.982555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629b237-fcf1-4f07-abb2-889dfd794b93 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.013279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e5962-ef2a-4f53-ac7c-30cd9fb0e404 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.046796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea053950-19ec-4b6f-a213-adba2d88cf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.047697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea053950-19ec-4b6f-a213-adba2d88cf3a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.048046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea053950-19ec-4b6f-a213-adba2d88cf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.048397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea053950-19ec-4b6f-a213-adba2d88cf3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.063310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea053950-19ec-4b6f-a213-adba2d88cf3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-ea053950-19ec-4b6f-a213-adba2d88cf3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:42.071266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:42.072377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:42.073211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 230/432] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:42.073867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea053950-19ec-4b6f-a213-adba2d88cf3a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.091096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629b237-fcf1-4f07-abb2-889dfd794b93 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.125779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf357d7-b36f-4b5f-9eaa-67d83625eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.126662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf357d7-b36f-4b5f-9eaa-67d83625eb0c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.126971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf357d7-b36f-4b5f-9eaa-67d83625eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.127241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf357d7-b36f-4b5f-9eaa-67d83625eb0c None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.128415 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf357d7-b36f-4b5f-9eaa-67d83625eb0c None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:42.129852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf357d7-b36f-4b5f-9eaa-67d83625eb0c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:42.131806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 203/433] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:41 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:42.132629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf357d7-b36f-4b5f-9eaa-67d83625eb0c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.179620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea053950-19ec-4b6f-a213-adba2d88cf3a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.212036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0e01-c9ce-4c11-a8ad-5dd9d26069bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.212886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0e01-c9ce-4c11-a8ad-5dd9d26069bc None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.213168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0e01-c9ce-4c11-a8ad-5dd9d26069bc None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.213581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a0e01-c9ce-4c11-a8ad-5dd9d26069bc None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.214800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a0e01-c9ce-4c11-a8ad-5dd9d26069bc None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:42.216272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a0e01-c9ce-4c11-a8ad-5dd9d26069bc None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:42.217892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 231/434] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:42 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:42.218675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0e01-c9ce-4c11-a8ad-5dd9d26069bc None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.237897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf357d7-b36f-4b5f-9eaa-67d83625eb0c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.272353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de390b2-5105-4b33-8d1a-067602d45810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.273156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de390b2-5105-4b33-8d1a-067602d45810 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.273433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de390b2-5105-4b33-8d1a-067602d45810 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.273705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de390b2-5105-4b33-8d1a-067602d45810 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.283300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de390b2-5105-4b33-8d1a-067602d45810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0de390b2-5105-4b33-8d1a-067602d45810 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:42.291275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:42.292352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 204/435] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:42.293223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de390b2-5105-4b33-8d1a-067602d45810 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.317252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a0e01-c9ce-4c11-a8ad-5dd9d26069bc None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.348655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac89e81-56d8-44fb-b1c7-3dd3df26180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.349434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89e81-56d8-44fb-b1c7-3dd3df26180c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.349802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89e81-56d8-44fb-b1c7-3dd3df26180c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.350185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89e81-56d8-44fb-b1c7-3dd3df26180c None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.351000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac89e81-56d8-44fb-b1c7-3dd3df26180c None admin] RBAC: Adding query filter params (name=member) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:42.351377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac89e81-56d8-44fb-b1c7-3dd3df26180c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:42.352807 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac89e81-56d8-44fb-b1c7-3dd3df26180c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:42.360582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 232/436] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:55:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:42.361419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac89e81-56d8-44fb-b1c7-3dd3df26180c None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.388049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de390b2-5105-4b33-8d1a-067602d45810 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.419424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485213e-5a74-4a05-9fcd-843342dac1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.420153 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485213e-5a74-4a05-9fcd-843342dac1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.420495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485213e-5a74-4a05-9fcd-843342dac1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.420835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485213e-5a74-4a05-9fcd-843342dac1c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.421726 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485213e-5a74-4a05-9fcd-843342dac1c8 None admin] RBAC: Adding query filter params (group.id=db2e559a92004ea8891f8a7d00bee836, role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=db8112f1b83d4722a9c6776f739c6c71) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:42.422122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485213e-5a74-4a05-9fcd-843342dac1c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:42.423561 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485213e-5a74-4a05-9fcd-843342dac1c8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:42.429149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 205/437] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:42 2022] GET /identity/v3/role_assignments?group.id=db2e559a92004ea8891f8a7d00bee836&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:42.430841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aeefa-67ab-4191-b8f9-c2d3059298c5 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.431075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aeefa-67ab-4191-b8f9-c2d3059298c5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.431354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aeefa-67ab-4191-b8f9-c2d3059298c5 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.432760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 206/438] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:42.433354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aeefa-67ab-4191-b8f9-c2d3059298c5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.459485 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac89e81-56d8-44fb-b1c7-3dd3df26180c None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.499413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0872b-25e7-44fb-8280-e7cd2678e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.500581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0872b-25e7-44fb-8280-e7cd2678e1ff None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.500869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0872b-25e7-44fb-8280-e7cd2678e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.501142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0872b-25e7-44fb-8280-e7cd2678e1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.502847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0872b-25e7-44fb-8280-e7cd2678e1ff None admin] RBAC: Adding query filter params (group.id=db2e559a92004ea8891f8a7d00bee836, role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=db8112f1b83d4722a9c6776f739c6c71) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:42.503162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0872b-25e7-44fb-8280-e7cd2678e1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:42.505422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0872b-25e7-44fb-8280-e7cd2678e1ff None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:42.526513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 233/439] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:42 2022] GET /identity/v3/role_assignments?group.id=db2e559a92004ea8891f8a7d00bee836&scope.project.id=db8112f1b83d4722a9c6776f739c6c71&role.id=638115ca27864c64a0554c5c0913956a => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:42.526513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0872b-25e7-44fb-8280-e7cd2678e1ff None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.557023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aeefa-67ab-4191-b8f9-c2d3059298c5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.599240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113f0f0-897e-4e0a-b570-472ce31d31bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.600502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113f0f0-897e-4e0a-b570-472ce31d31bb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.600936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113f0f0-897e-4e0a-b570-472ce31d31bb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.601502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113f0f0-897e-4e0a-b570-472ce31d31bb None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.602832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113f0f0-897e-4e0a-b570-472ce31d31bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:42.603335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113f0f0-897e-4e0a-b570-472ce31d31bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:42.604958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113f0f0-897e-4e0a-b570-472ce31d31bb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:42.615337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 207/440] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:42.617059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30dd2b-9deb-4dbe-9ef7-37be5539ef1e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.617499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30dd2b-9deb-4dbe-9ef7-37be5539ef1e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.617916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30dd2b-9deb-4dbe-9ef7-37be5539ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.635872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0c30dd2b-9deb-4dbe-9ef7-37be5539ef1e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:42.637328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0c30dd2b-9deb-4dbe-9ef7-37be5539ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:42.664603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0872b-25e7-44fb-8280-e7cd2678e1ff None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.713642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 208/441] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:42.714500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30dd2b-9deb-4dbe-9ef7-37be5539ef1e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.719961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff4398-446e-4f84-a316-c0937fd5d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.719961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff4398-446e-4f84-a316-c0937fd5d968 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.720179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff4398-446e-4f84-a316-c0937fd5d968 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.720403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff4398-446e-4f84-a316-c0937fd5d968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.802035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff4398-446e-4f84-a316-c0937fd5d968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:42.803663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff4398-446e-4f84-a316-c0937fd5d968 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:42.838373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30dd2b-9deb-4dbe-9ef7-37be5539ef1e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:42.880284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bf4ef-b2db-4aca-ac4e-71401407146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:42.880484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf4ef-b2db-4aca-ac4e-71401407146d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:42.880744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf4ef-b2db-4aca-ac4e-71401407146d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:42.880989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf4ef-b2db-4aca-ac4e-71401407146d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:42.910020 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 234/442] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:42.910835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff4398-446e-4f84-a316-c0937fd5d968 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:42.960082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bf4ef-b2db-4aca-ac4e-71401407146d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:42.963139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bf4ef-b2db-4aca-ac4e-71401407146d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.026111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff4398-446e-4f84-a316-c0937fd5d968 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.061637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284a078-e669-4fa1-872a-77f4f4a89378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.062445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a078-e669-4fa1-872a-77f4f4a89378 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.062718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a078-e669-4fa1-872a-77f4f4a89378 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.062978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284a078-e669-4fa1-872a-77f4f4a89378 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.072361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284a078-e669-4fa1-872a-77f4f4a89378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:43.073088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 209/443] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:43.073739 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bf4ef-b2db-4aca-ac4e-71401407146d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-2284a078-e669-4fa1-872a-77f4f4a89378 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:43.080147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:43.081183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:43.081987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 235/444] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:55:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:43.082673 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284a078-e669-4fa1-872a-77f4f4a89378 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.167902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bf4ef-b2db-4aca-ac4e-71401407146d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.175826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284a078-e669-4fa1-872a-77f4f4a89378 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.199523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be603d-b437-4b84-9ae7-2e7cb6865b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.200371 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be603d-b437-4b84-9ae7-2e7cb6865b22 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.200650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be603d-b437-4b84-9ae7-2e7cb6865b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.200919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be603d-b437-4b84-9ae7-2e7cb6865b22 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.202113 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be603d-b437-4b84-9ae7-2e7cb6865b22 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.203545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be603d-b437-4b84-9ae7-2e7cb6865b22 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.205232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 210/445] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:43.205981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be603d-b437-4b84-9ae7-2e7cb6865b22 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.208358 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730838bf-fc02-4d09-9c4b-4dc50c8b7e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.209206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730838bf-fc02-4d09-9c4b-4dc50c8b7e81 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.209756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730838bf-fc02-4d09-9c4b-4dc50c8b7e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.209856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730838bf-fc02-4d09-9c4b-4dc50c8b7e81 None admin] PATH_INFO: `/v3/projects/da3df20a1f56481987bf9fc24fcac939` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.211279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730838bf-fc02-4d09-9c4b-4dc50c8b7e81 None admin] RBAC: Authorizing `identity:get_project(project_id=da3df20a1f56481987bf9fc24fcac939)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.212689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730838bf-fc02-4d09-9c4b-4dc50c8b7e81 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.214381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 236/446] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/projects/da3df20a1f56481987bf9fc24fcac939 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:43.215116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730838bf-fc02-4d09-9c4b-4dc50c8b7e81 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.298642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be603d-b437-4b84-9ae7-2e7cb6865b22 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.307000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730838bf-fc02-4d09-9c4b-4dc50c8b7e81 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.331486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598193a5-098f-414b-a46d-eeeac51cf8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.332142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598193a5-098f-414b-a46d-eeeac51cf8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.332420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598193a5-098f-414b-a46d-eeeac51cf8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.332689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598193a5-098f-414b-a46d-eeeac51cf8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.333433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598193a5-098f-414b-a46d-eeeac51cf8c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:43.333733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598193a5-098f-414b-a46d-eeeac51cf8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.335144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598193a5-098f-414b-a46d-eeeac51cf8c1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.338916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea922-cebe-4afa-8363-abd8a3ded4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.339830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea922-cebe-4afa-8363-abd8a3ded4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.340098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea922-cebe-4afa-8363-abd8a3ded4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.340367 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea922-cebe-4afa-8363-abd8a3ded4f9 None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.341534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aea922-cebe-4afa-8363-abd8a3ded4f9 None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.342993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aea922-cebe-4afa-8363-abd8a3ded4f9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.343184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 211/447] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:43.343965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598193a5-098f-414b-a46d-eeeac51cf8c1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.344682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 237/448] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:43.349555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea922-cebe-4afa-8363-abd8a3ded4f9 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.438934 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598193a5-098f-414b-a46d-eeeac51cf8c1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.441657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea922-cebe-4afa-8363-abd8a3ded4f9 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.470037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5e53c-6edf-4b3c-b39f-ee80b4121246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.471509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5e53c-6edf-4b3c-b39f-ee80b4121246 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.471790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5e53c-6edf-4b3c-b39f-ee80b4121246 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.472059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5e53c-6edf-4b3c-b39f-ee80b4121246 None admin] PATH_INFO: `/v3/groups/db2e559a92004ea8891f8a7d00bee836` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.473211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5e53c-6edf-4b3c-b39f-ee80b4121246 None admin] RBAC: Authorizing `identity:get_group(group_id=db2e559a92004ea8891f8a7d00bee836)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.473983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9daab-1d72-4f96-aaed-0ed9d945b999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.474649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9daab-1d72-4f96-aaed-0ed9d945b999 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.474740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5e53c-6edf-4b3c-b39f-ee80b4121246 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.474933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9daab-1d72-4f96-aaed-0ed9d945b999 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.475209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9daab-1d72-4f96-aaed-0ed9d945b999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.476244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 212/449] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/groups/db2e559a92004ea8891f8a7d00bee836 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:43.476987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5e53c-6edf-4b3c-b39f-ee80b4121246 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.544193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9daab-1d72-4f96-aaed-0ed9d945b999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.545655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9daab-1d72-4f96-aaed-0ed9d945b999 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.571827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5e53c-6edf-4b3c-b39f-ee80b4121246 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.603475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f3d6-d502-4261-95c6-8dcc4c446a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.604114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f3d6-d502-4261-95c6-8dcc4c446a52 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.604401 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f3d6-d502-4261-95c6-8dcc4c446a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.604674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f3d6-d502-4261-95c6-8dcc4c446a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.605490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f3d6-d502-4261-95c6-8dcc4c446a52 None admin] RBAC: Adding query filter params (group.id=db2e559a92004ea8891f8a7d00bee836, role.id=d692349bc8bd4c8d940a2c7cacd96df8, scope.project.id=da3df20a1f56481987bf9fc24fcac939) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:43.605800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f3d6-d502-4261-95c6-8dcc4c446a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.607253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f3d6-d502-4261-95c6-8dcc4c446a52 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.612792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 213/450] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/role_assignments?group.id=db2e559a92004ea8891f8a7d00bee836&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=d692349bc8bd4c8d940a2c7cacd96df8 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:43.626261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f3d6-d502-4261-95c6-8dcc4c446a52 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.639036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 238/451] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 14:55:43.645408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9daab-1d72-4f96-aaed-0ed9d945b999 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.716666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f3d6-d502-4261-95c6-8dcc4c446a52 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.746222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9daab-1d72-4f96-aaed-0ed9d945b999 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.749732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ba28-4200-4b0b-97f7-6e8266619f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.750449 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ba28-4200-4b0b-97f7-6e8266619f0e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.750732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ba28-4200-4b0b-97f7-6e8266619f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.751004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ba28-4200-4b0b-97f7-6e8266619f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.752358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ba28-4200-4b0b-97f7-6e8266619f0e None admin] RBAC: Adding query filter params (group.id=db2e559a92004ea8891f8a7d00bee836, role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=da3df20a1f56481987bf9fc24fcac939) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:43.752670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ba28-4200-4b0b-97f7-6e8266619f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.754176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ba28-4200-4b0b-97f7-6e8266619f0e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.760325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 214/452] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/role_assignments?group.id=db2e559a92004ea8891f8a7d00bee836&scope.project.id=da3df20a1f56481987bf9fc24fcac939&role.id=638115ca27864c64a0554c5c0913956a => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:43.792655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6625239-998c-4dcc-b590-928a288efc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.793810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6625239-998c-4dcc-b590-928a288efc63 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.794106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6625239-998c-4dcc-b590-928a288efc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.794377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6625239-998c-4dcc-b590-928a288efc63 None admin] PATH_INFO: `/v3/projects/205b1267d8204d608304e6a78a0e361f` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.795685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6625239-998c-4dcc-b590-928a288efc63 None admin] RBAC: Authorizing `identity:get_project(project_id=205b1267d8204d608304e6a78a0e361f)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.797164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6625239-998c-4dcc-b590-928a288efc63 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.799146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 239/453] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/projects/205b1267d8204d608304e6a78a0e361f => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:43.805644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ba28-4200-4b0b-97f7-6e8266619f0e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:43.923446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ba28-4200-4b0b-97f7-6e8266619f0e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:43.959205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b34b1-ceaf-4c56-b7d4-634251c40249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:43.960062 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b34b1-ceaf-4c56-b7d4-634251c40249 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:43.960345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b34b1-ceaf-4c56-b7d4-634251c40249 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:43.960619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b34b1-ceaf-4c56-b7d4-634251c40249 None admin] PATH_INFO: `/v3/groups/e5660cab30f248d1be93bc6e1d55b4b5` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:43.962101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b34b1-ceaf-4c56-b7d4-634251c40249 None admin] RBAC: Authorizing `identity:get_group(group_id=e5660cab30f248d1be93bc6e1d55b4b5)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:43.963549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b34b1-ceaf-4c56-b7d4-634251c40249 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:43.965177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 215/454] 10.222.0.44 () {56 vars in 1180 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/groups/e5660cab30f248d1be93bc6e1d55b4b5 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:43.971072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6625239-998c-4dcc-b590-928a288efc63 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:44.074044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6625239-998c-4dcc-b590-928a288efc63 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:44.107982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259afc4-395b-4a3e-89b9-8492e4376e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:44.108639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259afc4-395b-4a3e-89b9-8492e4376e9a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:44.108919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259afc4-395b-4a3e-89b9-8492e4376e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:44.109193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259afc4-395b-4a3e-89b9-8492e4376e9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:44.110022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259afc4-395b-4a3e-89b9-8492e4376e9a None admin] RBAC: Adding query filter params (group.id=e5660cab30f248d1be93bc6e1d55b4b5, role.id=042169a166e14a80beac826291ceaf73, scope.project.id=205b1267d8204d608304e6a78a0e361f) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:44.110367 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259afc4-395b-4a3e-89b9-8492e4376e9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:44.112332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259afc4-395b-4a3e-89b9-8492e4376e9a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:44.118179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 240/455] 10.222.0.44 () {56 vars in 1376 bytes} [Mon May 16 14:55:43 2022] GET /identity/v3/role_assignments?group.id=e5660cab30f248d1be93bc6e1d55b4b5&scope.project.id=205b1267d8204d608304e6a78a0e361f&role.id=042169a166e14a80beac826291ceaf73 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:46.734045 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482c2c9-0553-4b01-85c2-7a9673b2f9cd None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:46.735103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482c2c9-0553-4b01-85c2-7a9673b2f9cd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:46.735589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482c2c9-0553-4b01-85c2-7a9673b2f9cd None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:46.737479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 216/456] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:46.742687 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365090-d3ca-428d-bb30-41496714e438 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:46.743508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365090-d3ca-428d-bb30-41496714e438 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:46.743998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9365090-d3ca-428d-bb30-41496714e438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:46.767017 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f9365090-d3ca-428d-bb30-41496714e438 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:46.769064 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f9365090-d3ca-428d-bb30-41496714e438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:46.843459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 241/457] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:46.888970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482c2c9-0553-4b01-85c2-7a9673b2f9cd None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:46.928883 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f73e2-af1c-40b5-8858-a4c912c5c26a None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:46.929197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f73e2-af1c-40b5-8858-a4c912c5c26a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:46.929439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f73e2-af1c-40b5-8858-a4c912c5c26a None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:46.931080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 242/458] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:46.942684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca28b9-f681-4d6b-8db0-147b4a74095a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:46.943244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca28b9-f681-4d6b-8db0-147b4a74095a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:46.943718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca28b9-f681-4d6b-8db0-147b4a74095a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:46.964380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2eca28b9-f681-4d6b-8db0-147b4a74095a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:46.965973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2eca28b9-f681-4d6b-8db0-147b4a74095a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:47.043385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 243/459] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:47.062843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482c2c9-0553-4b01-85c2-7a9673b2f9cd None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:47.088921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca28b9-f681-4d6b-8db0-147b4a74095a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:47.120577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7085cb-168a-471c-93bd-630e92e8504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:47.121731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7085cb-168a-471c-93bd-630e92e8504c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.122261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7085cb-168a-471c-93bd-630e92e8504c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.122730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7085cb-168a-471c-93bd-630e92e8504c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.143682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7085cb-168a-471c-93bd-630e92e8504c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:47.145477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7085cb-168a-471c-93bd-630e92e8504c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2b7085cb-168a-471c-93bd-630e92e8504c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:47.175227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:47.176165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:47.176996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:47.176996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:47.176996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:47.176996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:47.179363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 217/460] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:47.191103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7085cb-168a-471c-93bd-630e92e8504c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:47.202940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca28b9-f681-4d6b-8db0-147b4a74095a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:47.246863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23576eac-d183-4c86-9b54-7baa19950fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:47.248015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23576eac-d183-4c86-9b54-7baa19950fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.248295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23576eac-d183-4c86-9b54-7baa19950fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.248568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23576eac-d183-4c86-9b54-7baa19950fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.261842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23576eac-d183-4c86-9b54-7baa19950fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:47.263337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23576eac-d183-4c86-9b54-7baa19950fb4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-23576eac-d183-4c86-9b54-7baa19950fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:47.287905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:47.288793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:47.290241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:47.290241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:47.290241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:47.290241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:47.290241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 244/461] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:47.290827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff82f61-5354-4e3b-8f2d-b0aa4a6920e8 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.291136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff82f61-5354-4e3b-8f2d-b0aa4a6920e8 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.291411 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff82f61-5354-4e3b-8f2d-b0aa4a6920e8 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.292661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 245/462] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:47.297451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff82f61-5354-4e3b-8f2d-b0aa4a6920e8 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:47.300145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7085cb-168a-471c-93bd-630e92e8504c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:47.343640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f4012-aece-4b12-8ca7-67bc981e4d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:47.344594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4012-aece-4b12-8ca7-67bc981e4d46 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.344881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4012-aece-4b12-8ca7-67bc981e4d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.345140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f4012-aece-4b12-8ca7-67bc981e4d46 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.345925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4012-aece-4b12-8ca7-67bc981e4d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:47.346256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4012-aece-4b12-8ca7-67bc981e4d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:47.347610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f4012-aece-4b12-8ca7-67bc981e4d46 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:47.364778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 218/463] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:47.367015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712a1a-c9d5-4e92-a6a6-4b88af44a3e6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.367472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712a1a-c9d5-4e92-a6a6-4b88af44a3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.367937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712a1a-c9d5-4e92-a6a6-4b88af44a3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.391928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fe712a1a-c9d5-4e92-a6a6-4b88af44a3e6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:47.393680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fe712a1a-c9d5-4e92-a6a6-4b88af44a3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:47.405699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff82f61-5354-4e3b-8f2d-b0aa4a6920e8 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:47.451593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe83a30-ea7a-4481-8d6d-240495cc63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:47.453102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe83a30-ea7a-4481-8d6d-240495cc63f0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.453853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe83a30-ea7a-4481-8d6d-240495cc63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.454334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe83a30-ea7a-4481-8d6d-240495cc63f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.455431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe83a30-ea7a-4481-8d6d-240495cc63f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:47.456199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe83a30-ea7a-4481-8d6d-240495cc63f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:47.458234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe83a30-ea7a-4481-8d6d-240495cc63f0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:47.470309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 219/464] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:47.471839 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712a1a-c9d5-4e92-a6a6-4b88af44a3e6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:47.479363 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 246/465] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:47.487035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe83a30-ea7a-4481-8d6d-240495cc63f0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:47.579608 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712a1a-c9d5-4e92-a6a6-4b88af44a3e6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:47.597196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe83a30-ea7a-4481-8d6d-240495cc63f0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:47.614383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55786334-2cc0-4608-a46b-c2de1c1db675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:47.615245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55786334-2cc0-4608-a46b-c2de1c1db675 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.615429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55786334-2cc0-4608-a46b-c2de1c1db675 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.615806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55786334-2cc0-4608-a46b-c2de1c1db675 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.616573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55786334-2cc0-4608-a46b-c2de1c1db675 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:47.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55786334-2cc0-4608-a46b-c2de1c1db675 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:47.632158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e8214-5de5-45d7-8746-8f7d7ec815b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:47.633097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e8214-5de5-45d7-8746-8f7d7ec815b3 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.633548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e8214-5de5-45d7-8746-8f7d7ec815b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.633989 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e8214-5de5-45d7-8746-8f7d7ec815b3 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.634891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e8214-5de5-45d7-8746-8f7d7ec815b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:47.636478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e8214-5de5-45d7-8746-8f7d7ec815b3 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:47.696110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 220/466] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:47 2022] POST /identity/v3/users => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:47.697148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55786334-2cc0-4608-a46b-c2de1c1db675 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:47.716798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 247/467] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:47 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:47.719183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838068-2e61-47f5-97f8-829c311f817c None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.719772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838068-2e61-47f5-97f8-829c311f817c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.721107 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838068-2e61-47f5-97f8-829c311f817c None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.723251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 248/468] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:47.732157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584e568-1846-4932-b063-0d4988adf2c5 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.732157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584e568-1846-4932-b063-0d4988adf2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.732157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584e568-1846-4932-b063-0d4988adf2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.773521 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7584e568-1846-4932-b063-0d4988adf2c5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:47.774790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7584e568-1846-4932-b063-0d4988adf2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:47.908906 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55786334-2cc0-4608-a46b-c2de1c1db675 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:47.919718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 249/469] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:47.943244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584e568-1846-4932-b063-0d4988adf2c5 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:47.954291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9b57-7fea-4c7b-b0b9-a9d4d31ad8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:47.955629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9b57-7fea-4c7b-b0b9-a9d4d31ad8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:47.955914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9b57-7fea-4c7b-b0b9-a9d4d31ad8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:47.956187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9b57-7fea-4c7b-b0b9-a9d4d31ad8d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:47.972477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a9b57-7fea-4c7b-b0b9-a9d4d31ad8d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:47.975312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a9b57-7fea-4c7b-b0b9-a9d4d31ad8d7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f68a9b57-7fea-4c7b-b0b9-a9d4d31ad8d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:47.994597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:47.995498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:47.996339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:47.996339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:47.996339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:47.996339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:47.996339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 221/470] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:48.001831 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9b57-7fea-4c7b-b0b9-a9d4d31ad8d7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:48.077316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584e568-1846-4932-b063-0d4988adf2c5 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:48.121123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea54787-0066-41e7-a776-7d1e56f4e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:48.122100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea54787-0066-41e7-a776-7d1e56f4e977 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:48.122695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea54787-0066-41e7-a776-7d1e56f4e977 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:48.122975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea54787-0066-41e7-a776-7d1e56f4e977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:48.125274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9b57-7fea-4c7b-b0b9-a9d4d31ad8d7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:48.134911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea54787-0066-41e7-a776-7d1e56f4e977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:48.137138 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea54787-0066-41e7-a776-7d1e56f4e977 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-dea54787-0066-41e7-a776-7d1e56f4e977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:48.160543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:48.161416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:48.162306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:48.162306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:48.162306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:48.162306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:48.162306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 250/471] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:48.168095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea54787-0066-41e7-a776-7d1e56f4e977 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:48.171255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd462f2-4700-4032-9f3a-8f47b6f0432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:48.173160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd462f2-4700-4032-9f3a-8f47b6f0432e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:48.173459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd462f2-4700-4032-9f3a-8f47b6f0432e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:48.173768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd462f2-4700-4032-9f3a-8f47b6f0432e None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:48.174534 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd462f2-4700-4032-9f3a-8f47b6f0432e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:48.174837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd462f2-4700-4032-9f3a-8f47b6f0432e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:48.176246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd462f2-4700-4032-9f3a-8f47b6f0432e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:48.197335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 222/472] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:48.203739 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd462f2-4700-4032-9f3a-8f47b6f0432e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:48.280779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea54787-0066-41e7-a776-7d1e56f4e977 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:48.327366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5640bcf-f936-48f7-a3a4-3b4f189af383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:48.328033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5640bcf-f936-48f7-a3a4-3b4f189af383 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:48.328310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5640bcf-f936-48f7-a3a4-3b4f189af383 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:48.328578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5640bcf-f936-48f7-a3a4-3b4f189af383 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:48.329302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5640bcf-f936-48f7-a3a4-3b4f189af383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:48.329604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5640bcf-f936-48f7-a3a4-3b4f189af383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:48.331059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5640bcf-f936-48f7-a3a4-3b4f189af383 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:48.343231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 251/473] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:48.351059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5640bcf-f936-48f7-a3a4-3b4f189af383 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:48.353325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd462f2-4700-4032-9f3a-8f47b6f0432e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:48.388399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0507dd-91db-4cc4-97a2-e6ed821527cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:48.389095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0507dd-91db-4cc4-97a2-e6ed821527cd None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:48.389426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0507dd-91db-4cc4-97a2-e6ed821527cd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:48.389702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0507dd-91db-4cc4-97a2-e6ed821527cd None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:48.390837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0507dd-91db-4cc4-97a2-e6ed821527cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:48.393187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0507dd-91db-4cc4-97a2-e6ed821527cd None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:48.471142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5640bcf-f936-48f7-a3a4-3b4f189af383 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:48.498430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 223/474] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:48 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:48.500012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d714f8a-0638-440a-936d-3cda0dd9abae None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:48.500304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d714f8a-0638-440a-936d-3cda0dd9abae None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:48.500585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d714f8a-0638-440a-936d-3cda0dd9abae None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:48.502165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 224/475] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:48.511486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f80c0-4cbe-45f1-bd77-98f77953aa4e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:48.511817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f80c0-4cbe-45f1-bd77-98f77953aa4e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:48.512091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f80c0-4cbe-45f1-bd77-98f77953aa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:48.518013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8fb69-4f24-4b80-8d17-08028ece966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:48.519660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8fb69-4f24-4b80-8d17-08028ece966e None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:48.519946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8fb69-4f24-4b80-8d17-08028ece966e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:48.520218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8fb69-4f24-4b80-8d17-08028ece966e None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:48.520988 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8fb69-4f24-4b80-8d17-08028ece966e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:48.522513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8fb69-4f24-4b80-8d17-08028ece966e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:48.539620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-166f80c0-4cbe-45f1-bd77-98f77953aa4e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:48.540947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-166f80c0-4cbe-45f1-bd77-98f77953aa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:48.619332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 252/476] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:48 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:48.622010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 225/477] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:48.647470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8fb69-4f24-4b80-8d17-08028ece966e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:48.766550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8fb69-4f24-4b80-8d17-08028ece966e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:48.805128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:48.806886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:48.807395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:48.807899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:48.808983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:48.810844 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:48.849897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.sql.core [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 14:55:48.849897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 14:55:48.849897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [parameters: {'id': '107fc5db2b584c82939c29942e570139', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 14:55:48.849897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80179) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application conn.query(q) May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application result.read() May 16 14:55:48.867331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return ref.to_dict() May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:55:48.868247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application next(self.gen) May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application yield resource May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application next(self.gen) May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.session.rollback() May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.force_reraise() May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise self.value May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application session.commit() May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 14:55:48.869183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._prepare_impl() May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.session.flush() May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._flush(objects) May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application compat.raise_( May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application flush_context.execute() May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rec.execute(self) May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 14:55:48.870023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:55:48.875368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application conn.query(q) May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application result.read() May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:55:48.876262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [parameters: {'id': '107fc5db2b584c82939c29942e570139', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:48.877062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 14:55:48.877866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:48.878756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 253/478] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 16 14:55:48 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:48.880959 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f80c0-4cbe-45f1-bd77-98f77953aa4e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:49.002369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f80c0-4cbe-45f1-bd77-98f77953aa4e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:49.046246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fafbd6-de16-4756-bc77-e13b5f5006c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:49.047326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fafbd6-de16-4756-bc77-e13b5f5006c7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:49.047750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fafbd6-de16-4756-bc77-e13b5f5006c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:49.048173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fafbd6-de16-4756-bc77-e13b5f5006c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:49.066919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fafbd6-de16-4756-bc77-e13b5f5006c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-d3fafbd6-de16-4756-bc77-e13b5f5006c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:49.075346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:49.076253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 14:55:49.077046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:49.079285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 226/479] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:55:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:49.086427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:49.245644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997aa5a-5ffa-41fc-8912-da0daf3fd96f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:49.294818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e7803-ebc3-4c9e-935c-3d4aa268b415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:49.295494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e7803-ebc3-4c9e-935c-3d4aa268b415 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:49.295772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e7803-ebc3-4c9e-935c-3d4aa268b415 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:49.296043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e7803-ebc3-4c9e-935c-3d4aa268b415 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:49.296849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e7803-ebc3-4c9e-935c-3d4aa268b415 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:49.297098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e7803-ebc3-4c9e-935c-3d4aa268b415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:49.298509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e7803-ebc3-4c9e-935c-3d4aa268b415 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:49.307548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 254/480] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:50.409577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e8ac0-30da-434e-bba7-9d5fcfe7648a None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:50.409577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e8ac0-30da-434e-bba7-9d5fcfe7648a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:50.409577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e8ac0-30da-434e-bba7-9d5fcfe7648a None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:50.410669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 227/481] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:50.414714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48732-bdaa-4969-a4f2-d788bc2cfaec None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:50.415148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48732-bdaa-4969-a4f2-d788bc2cfaec None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:50.415332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48732-bdaa-4969-a4f2-d788bc2cfaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:50.431753 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a0d48732-bdaa-4969-a4f2-d788bc2cfaec None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:50.432921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a0d48732-bdaa-4969-a4f2-d788bc2cfaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:50.476578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913610a3-b689-4075-95b6-ea888cc2d6d0 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:50.476922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913610a3-b689-4075-95b6-ea888cc2d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:50.477135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913610a3-b689-4075-95b6-ea888cc2d6d0 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:50.478779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 228/482] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:50.483603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5282de1-39e7-427d-9ddf-5be242bf64c6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:50.483890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5282de1-39e7-427d-9ddf-5be242bf64c6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:50.484166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5282de1-39e7-427d-9ddf-5be242bf64c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:50.508558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a5282de1-39e7-427d-9ddf-5be242bf64c6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:50.510605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a5282de1-39e7-427d-9ddf-5be242bf64c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:50.524380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 255/483] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:55:50.552022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d48732-bdaa-4969-a4f2-d788bc2cfaec None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:50.618001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 229/484] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:50.655491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5282de1-39e7-427d-9ddf-5be242bf64c6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:50.695924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d48732-bdaa-4969-a4f2-d788bc2cfaec None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:50.747297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b9cde-37f9-4950-bff6-e850777b478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:50.748093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b9cde-37f9-4950-bff6-e850777b478e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:50.748375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b9cde-37f9-4950-bff6-e850777b478e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:50.748649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b9cde-37f9-4950-bff6-e850777b478e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:50.769713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b9cde-37f9-4950-bff6-e850777b478e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-914b9cde-37f9-4950-bff6-e850777b478e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:50.782237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:50.783819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:50.784694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:50.786134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 256/485] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:50.792121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b9cde-37f9-4950-bff6-e850777b478e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:50.817051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5282de1-39e7-427d-9ddf-5be242bf64c6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:50.852440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0796f7d-d2ad-4fda-b751-b4a6027f4f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:50.853234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0796f7d-d2ad-4fda-b751-b4a6027f4f51 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:50.853510 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0796f7d-d2ad-4fda-b751-b4a6027f4f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:50.853778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0796f7d-d2ad-4fda-b751-b4a6027f4f51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:50.874363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0796f7d-d2ad-4fda-b751-b4a6027f4f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e0796f7d-d2ad-4fda-b751-b4a6027f4f51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:50.882011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:50.882936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:50.883746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:50.890823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 230/486] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:55:50.893244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0796f7d-d2ad-4fda-b751-b4a6027f4f51 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:50.982213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b9cde-37f9-4950-bff6-e850777b478e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:51.043748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55491b-fb60-4cdd-92ed-35ddf0918cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:51.044769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55491b-fb60-4cdd-92ed-35ddf0918cfa None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.045052 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55491b-fb60-4cdd-92ed-35ddf0918cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.045634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55491b-fb60-4cdd-92ed-35ddf0918cfa None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.046424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55491b-fb60-4cdd-92ed-35ddf0918cfa None admin] RBAC: Adding query filter params (name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:51.046730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55491b-fb60-4cdd-92ed-35ddf0918cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:51.048272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55491b-fb60-4cdd-92ed-35ddf0918cfa None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:51.057794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 257/487] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:55:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:51.063359 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55491b-fb60-4cdd-92ed-35ddf0918cfa None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:51.096888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0796f7d-d2ad-4fda-b751-b4a6027f4f51 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:51.133707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16367340-6b52-4f7f-a42e-8663d531458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:51.134406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16367340-6b52-4f7f-a42e-8663d531458a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.134686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16367340-6b52-4f7f-a42e-8663d531458a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.134955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16367340-6b52-4f7f-a42e-8663d531458a None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.135698 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16367340-6b52-4f7f-a42e-8663d531458a None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:51.135998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16367340-6b52-4f7f-a42e-8663d531458a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:51.138597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16367340-6b52-4f7f-a42e-8663d531458a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:51.151186 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 231/488] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:55:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:51.152367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16367340-6b52-4f7f-a42e-8663d531458a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:51.240325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55491b-fb60-4cdd-92ed-35ddf0918cfa None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:51.277214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997374ae-8f7e-4779-afb9-61e3c5499af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:51.278017 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997374ae-8f7e-4779-afb9-61e3c5499af2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.278329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997374ae-8f7e-4779-afb9-61e3c5499af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.278599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997374ae-8f7e-4779-afb9-61e3c5499af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.299854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997374ae-8f7e-4779-afb9-61e3c5499af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:51.301354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997374ae-8f7e-4779-afb9-61e3c5499af2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:51.316767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16367340-6b52-4f7f-a42e-8663d531458a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-997374ae-8f7e-4779-afb9-61e3c5499af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:51.340444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:51.341374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:51.342258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:51.342258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:51.342258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:51.342258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:51.343967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 258/489] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:51.349127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997374ae-8f7e-4779-afb9-61e3c5499af2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:51.406768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3be28-0a45-4e8c-80f1-4ac8e4c5599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:51.407969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3be28-0a45-4e8c-80f1-4ac8e4c5599e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.408483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3be28-0a45-4e8c-80f1-4ac8e4c5599e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.409001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3be28-0a45-4e8c-80f1-4ac8e4c5599e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.426159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3be28-0a45-4e8c-80f1-4ac8e4c5599e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:51.428343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3be28-0a45-4e8c-80f1-4ac8e4c5599e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:51.454355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997374ae-8f7e-4779-afb9-61e3c5499af2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-48b3be28-0a45-4e8c-80f1-4ac8e4c5599e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:51.466103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:51.466978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:51.468237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:51.468237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:51.468237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:51.468237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:51.468237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 232/490] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:51.474236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3be28-0a45-4e8c-80f1-4ac8e4c5599e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:51.499764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907207-1b88-4677-bf2a-2846b23fc3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:51.500349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907207-1b88-4677-bf2a-2846b23fc3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.500631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907207-1b88-4677-bf2a-2846b23fc3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.500902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907207-1b88-4677-bf2a-2846b23fc3e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.501629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc907207-1b88-4677-bf2a-2846b23fc3e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:51.502669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc907207-1b88-4677-bf2a-2846b23fc3e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:51.504051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc907207-1b88-4677-bf2a-2846b23fc3e9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:51.527270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 259/491] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:51.535020 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907207-1b88-4677-bf2a-2846b23fc3e9 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:51.609566 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3be28-0a45-4e8c-80f1-4ac8e4c5599e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:51.640494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907207-1b88-4677-bf2a-2846b23fc3e9 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:51.641949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc2462-924b-4f03-9a09-59d6a1758636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:51.642672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2462-924b-4f03-9a09-59d6a1758636 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.642954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2462-924b-4f03-9a09-59d6a1758636 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.643227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc2462-924b-4f03-9a09-59d6a1758636 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.643936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc2462-924b-4f03-9a09-59d6a1758636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:51.644236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc2462-924b-4f03-9a09-59d6a1758636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:51.645598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc2462-924b-4f03-9a09-59d6a1758636 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:51.657076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 233/492] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:51.659473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fc5af-9c05-4511-9e55-f5aa50e748ac None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.659965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fc5af-9c05-4511-9e55-f5aa50e748ac None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.660469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fc5af-9c05-4511-9e55-f5aa50e748ac None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.662538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 234/493] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:51.663994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba021c-c590-4df5-a9e9-0753026f9abc None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.664582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba021c-c590-4df5-a9e9-0753026f9abc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.665095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba021c-c590-4df5-a9e9-0753026f9abc None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.667067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 235/494] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:51.667977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba021c-c590-4df5-a9e9-0753026f9abc None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:51.679960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396995d-6739-47d0-ae96-a4bb16ce846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:51.680748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396995d-6739-47d0-ae96-a4bb16ce846a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.681024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396995d-6739-47d0-ae96-a4bb16ce846a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.681289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396995d-6739-47d0-ae96-a4bb16ce846a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.688369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396995d-6739-47d0-ae96-a4bb16ce846a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:51.690465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396995d-6739-47d0-ae96-a4bb16ce846a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-4396995d-6739-47d0-ae96-a4bb16ce846a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:55:51.706170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:51.707266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:51.708184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 260/495] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:51.708737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c237-9e61-4b7a-be32-1f2ff6bc8397 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.708883 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c237-9e61-4b7a-be32-1f2ff6bc8397 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.709158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3c237-9e61-4b7a-be32-1f2ff6bc8397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.726591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-54e3c237-9e61-4b7a-be32-1f2ff6bc8397 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:51.727755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-54e3c237-9e61-4b7a-be32-1f2ff6bc8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:51.773151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba021c-c590-4df5-a9e9-0753026f9abc None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:51.806273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 261/496] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:51.806273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9966b2-e5ea-424e-a1e0-2b24f383fcd5 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.806273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9966b2-e5ea-424e-a1e0-2b24f383fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.806273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9966b2-e5ea-424e-a1e0-2b24f383fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.813198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-bd9966b2-e5ea-424e-a1e0-2b24f383fcd5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:51.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bd9966b2-e5ea-424e-a1e0-2b24f383fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:51.826760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe19c-924b-4d4b-b9fa-93c12aedb2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:51.827919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe19c-924b-4d4b-b9fa-93c12aedb2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:51.828207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe19c-924b-4d4b-b9fa-93c12aedb2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:51.828645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe19c-924b-4d4b-b9fa-93c12aedb2f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:51.838676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fe19c-924b-4d4b-b9fa-93c12aedb2f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:51.840332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fe19c-924b-4d4b-b9fa-93c12aedb2f3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-571fe19c-924b-4d4b-b9fa-93c12aedb2f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:55:51.855757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:51.856779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:51.857652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 236/497] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 16 14:55:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:51.858261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe19c-924b-4d4b-b9fa-93c12aedb2f3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:51.883826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 262/498] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:51.884666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9966b2-e5ea-424e-a1e0-2b24f383fcd5 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:51.964919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe19c-924b-4d4b-b9fa-93c12aedb2f3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:51.995321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9966b2-e5ea-424e-a1e0-2b24f383fcd5 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.004574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9b330-4f9d-49cd-989f-defe530ef97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.005308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9b330-4f9d-49cd-989f-defe530ef97e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.005599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9b330-4f9d-49cd-989f-defe530ef97e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.005924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9b330-4f9d-49cd-989f-defe530ef97e None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.006789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9b330-4f9d-49cd-989f-defe530ef97e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:52.007102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9b330-4f9d-49cd-989f-defe530ef97e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:52.008611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9b330-4f9d-49cd-989f-defe530ef97e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:52.029423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47515764-4683-4b94-9339-e3b9487ad877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.030161 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47515764-4683-4b94-9339-e3b9487ad877 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.030441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47515764-4683-4b94-9339-e3b9487ad877 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.030706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47515764-4683-4b94-9339-e3b9487ad877 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.040744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47515764-4683-4b94-9339-e3b9487ad877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:52.050548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 237/499] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 16 14:55:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:52.050548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9b330-4f9d-49cd-989f-defe530ef97e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-47515764-4683-4b94-9339-e3b9487ad877 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:52.050782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:52.051586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 263/500] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:52.052381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47515764-4683-4b94-9339-e3b9487ad877 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.149889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47515764-4683-4b94-9339-e3b9487ad877 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.152918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9b330-4f9d-49cd-989f-defe530ef97e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.180979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d889589-a679-4796-b935-628b7c3d9ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.181756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d889589-a679-4796-b935-628b7c3d9ffe None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.182034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d889589-a679-4796-b935-628b7c3d9ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.182360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d889589-a679-4796-b935-628b7c3d9ffe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.184190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1fbb5-dfc7-4e22-8a6d-e16fd7ef7cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.184844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1fbb5-dfc7-4e22-8a6d-e16fd7ef7cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.185124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1fbb5-dfc7-4e22-8a6d-e16fd7ef7cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.185397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1fbb5-dfc7-4e22-8a6d-e16fd7ef7cd7 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.186253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1fbb5-dfc7-4e22-8a6d-e16fd7ef7cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:52.186562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1fbb5-dfc7-4e22-8a6d-e16fd7ef7cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:52.188004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1fbb5-dfc7-4e22-8a6d-e16fd7ef7cd7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:52.192513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d889589-a679-4796-b935-628b7c3d9ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-2d889589-a679-4796-b935-628b7c3d9ffe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:52.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:52.201291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:52.202278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 264/501] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:52.203201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d889589-a679-4796-b935-628b7c3d9ffe None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.207469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 238/502] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:52.208351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1fbb5-dfc7-4e22-8a6d-e16fd7ef7cd7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.295207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d889589-a679-4796-b935-628b7c3d9ffe None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.298411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1fbb5-dfc7-4e22-8a6d-e16fd7ef7cd7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.326440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9345ca2-5554-42b6-837b-c2744440dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.327068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345ca2-5554-42b6-837b-c2744440dc00 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.327348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345ca2-5554-42b6-837b-c2744440dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.327616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345ca2-5554-42b6-837b-c2744440dc00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.331196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97295de8-df67-4a59-b600-4f23c5322275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.331878 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97295de8-df67-4a59-b600-4f23c5322275 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.332159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97295de8-df67-4a59-b600-4f23c5322275 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.332430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97295de8-df67-4a59-b600-4f23c5322275 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.333166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97295de8-df67-4a59-b600-4f23c5322275 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:52.333468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97295de8-df67-4a59-b600-4f23c5322275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:52.334871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97295de8-df67-4a59-b600-4f23c5322275 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:52.342769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 239/503] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:52.344029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f93db8-67d0-49d8-80c2-4b577859b2e3 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.344295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f93db8-67d0-49d8-80c2-4b577859b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.344505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f93db8-67d0-49d8-80c2-4b577859b2e3 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.345934 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 240/504] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:52.346463 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f93db8-67d0-49d8-80c2-4b577859b2e3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.397073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9345ca2-5554-42b6-837b-c2744440dc00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:52.398665 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9345ca2-5554-42b6-837b-c2744440dc00 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:52.441354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f93db8-67d0-49d8-80c2-4b577859b2e3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.472230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723170ce-2654-419f-8021-1f54e9ea7858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.472881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723170ce-2654-419f-8021-1f54e9ea7858 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.473159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723170ce-2654-419f-8021-1f54e9ea7858 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.473431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723170ce-2654-419f-8021-1f54e9ea7858 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.474197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723170ce-2654-419f-8021-1f54e9ea7858 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:52.474506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723170ce-2654-419f-8021-1f54e9ea7858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:52.475879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723170ce-2654-419f-8021-1f54e9ea7858 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:52.483500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 241/505] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:52.484078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723170ce-2654-419f-8021-1f54e9ea7858 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.497753 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 265/506] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:52.499241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a08a8-f01a-434f-bd87-d3f8ee98819f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.499583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a08a8-f01a-434f-bd87-d3f8ee98819f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.499895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a08a8-f01a-434f-bd87-d3f8ee98819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.518163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-4d5a08a8-f01a-434f-bd87-d3f8ee98819f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:52.519484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4d5a08a8-f01a-434f-bd87-d3f8ee98819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:52.576243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723170ce-2654-419f-8021-1f54e9ea7858 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.583909 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 266/507] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:52.584761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a08a8-f01a-434f-bd87-d3f8ee98819f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.622701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61421f-292e-47bc-b013-b99bb0c7331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.623345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61421f-292e-47bc-b013-b99bb0c7331c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.623628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61421f-292e-47bc-b013-b99bb0c7331c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.623905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61421f-292e-47bc-b013-b99bb0c7331c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.675133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a08a8-f01a-434f-bd87-d3f8ee98819f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.686860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61421f-292e-47bc-b013-b99bb0c7331c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:52.688307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61421f-292e-47bc-b013-b99bb0c7331c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:52.706633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29b035-e5f4-4012-887f-51069ead11b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.707409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29b035-e5f4-4012-887f-51069ead11b2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.707683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29b035-e5f4-4012-887f-51069ead11b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.707950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29b035-e5f4-4012-887f-51069ead11b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.717764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29b035-e5f4-4012-887f-51069ead11b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:52.719635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29b035-e5f4-4012-887f-51069ead11b2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-0b29b035-e5f4-4012-887f-51069ead11b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:52.738088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:52.739033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:52.739852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:52.739852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:52.739852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:52.739852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:52.739852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 267/508] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:52.740133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29b035-e5f4-4012-887f-51069ead11b2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.782792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 242/509] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:52.784123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61421f-292e-47bc-b013-b99bb0c7331c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.839668 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29b035-e5f4-4012-887f-51069ead11b2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.871494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d005dd-eea7-48e9-b700-d409fce25e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.872265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d005dd-eea7-48e9-b700-d409fce25e19 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.872548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d005dd-eea7-48e9-b700-d409fce25e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.872825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d005dd-eea7-48e9-b700-d409fce25e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.874750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61421f-292e-47bc-b013-b99bb0c7331c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:52.882264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d005dd-eea7-48e9-b700-d409fce25e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:52.883700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d005dd-eea7-48e9-b700-d409fce25e19 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-34d005dd-eea7-48e9-b700-d409fce25e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:52.900258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:52.901262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:52.902339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:52.902339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:52.902339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:52.902339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:52.902339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 268/510] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:52.902339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d005dd-eea7-48e9-b700-d409fce25e19 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.910344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ba90-f16b-4fad-8adc-9773be0f02d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:52.911126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ba90-f16b-4fad-8adc-9773be0f02d2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:52.911428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ba90-f16b-4fad-8adc-9773be0f02d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:52.911700 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442ba90-f16b-4fad-8adc-9773be0f02d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:52.921176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442ba90-f16b-4fad-8adc-9773be0f02d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:52.922666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442ba90-f16b-4fad-8adc-9773be0f02d2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9442ba90-f16b-4fad-8adc-9773be0f02d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:52.939793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:52.940781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:52.946160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:52.946160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:52.946160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:52.946160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:52.946160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 243/511] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:52.946160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ba90-f16b-4fad-8adc-9773be0f02d2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:52.994533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d005dd-eea7-48e9-b700-d409fce25e19 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.025965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441467-c09f-427c-adc0-f02952728e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.026774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441467-c09f-427c-adc0-f02952728e53 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.027053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441467-c09f-427c-adc0-f02952728e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.027323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441467-c09f-427c-adc0-f02952728e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.037213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26441467-c09f-427c-adc0-f02952728e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.037612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442ba90-f16b-4fad-8adc-9773be0f02d2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.038774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26441467-c09f-427c-adc0-f02952728e53 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-26441467-c09f-427c-adc0-f02952728e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:53.055585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:53.056584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:53.057426 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:53.057426 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:53.057426 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:53.057426 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:53.057426 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 269/512] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:53.057691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441467-c09f-427c-adc0-f02952728e53 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.071445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e945ffe-fdf5-4a90-97e4-a04ce6131e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.072097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e945ffe-fdf5-4a90-97e4-a04ce6131e96 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.072374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e945ffe-fdf5-4a90-97e4-a04ce6131e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.072644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e945ffe-fdf5-4a90-97e4-a04ce6131e96 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.073352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e945ffe-fdf5-4a90-97e4-a04ce6131e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:53.073651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e945ffe-fdf5-4a90-97e4-a04ce6131e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.075064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e945ffe-fdf5-4a90-97e4-a04ce6131e96 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.087146 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 244/513] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:53.087943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e945ffe-fdf5-4a90-97e4-a04ce6131e96 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.153741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441467-c09f-427c-adc0-f02952728e53 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.180752 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e945ffe-fdf5-4a90-97e4-a04ce6131e96 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.187987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7c7c1-6459-4d7e-8587-5bde1b8b49ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.188760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c7c1-6459-4d7e-8587-5bde1b8b49ba None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.189038 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c7c1-6459-4d7e-8587-5bde1b8b49ba None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.189335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c7c1-6459-4d7e-8587-5bde1b8b49ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.198765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7c7c1-6459-4d7e-8587-5bde1b8b49ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.200208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7c7c1-6459-4d7e-8587-5bde1b8b49ba None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.214950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bc3c9-d8e3-4d2a-9ffc-e95e5ba697ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.215604 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc3c9-d8e3-4d2a-9ffc-e95e5ba697ac None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.215907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc3c9-d8e3-4d2a-9ffc-e95e5ba697ac None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.216180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc3c9-d8e3-4d2a-9ffc-e95e5ba697ac None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.216892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bc3c9-d8e3-4d2a-9ffc-e95e5ba697ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:53.217194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bc3c9-d8e3-4d2a-9ffc-e95e5ba697ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-d3e7c7c1-6459-4d7e-8587-5bde1b8b49ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:53.217290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:53.218306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:53.219254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:53.219254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:53.219254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:53.219254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:53.219254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 270/514] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:53.219545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bc3c9-d8e3-4d2a-9ffc-e95e5ba697ac None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.219619 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7c7c1-6459-4d7e-8587-5bde1b8b49ba None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.230024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 245/515] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:53.230835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bc3c9-d8e3-4d2a-9ffc-e95e5ba697ac None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.317295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7c7c1-6459-4d7e-8587-5bde1b8b49ba None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.322822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bc3c9-d8e3-4d2a-9ffc-e95e5ba697ac None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.349785 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4403bf-d7e4-4a26-8c34-1db026c66c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.350461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4403bf-d7e4-4a26-8c34-1db026c66c66 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.350737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4403bf-d7e4-4a26-8c34-1db026c66c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.351017 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4403bf-d7e4-4a26-8c34-1db026c66c66 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.351724 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4403bf-d7e4-4a26-8c34-1db026c66c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:53.352024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4403bf-d7e4-4a26-8c34-1db026c66c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.353371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4403bf-d7e4-4a26-8c34-1db026c66c66 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.355520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa3ad2-d92f-464e-a006-1b888a4d9573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.356163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3ad2-d92f-464e-a006-1b888a4d9573 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.356445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3ad2-d92f-464e-a006-1b888a4d9573 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.356718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3ad2-d92f-464e-a006-1b888a4d9573 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.357424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3ad2-d92f-464e-a006-1b888a4d9573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:53.357728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3ad2-d92f-464e-a006-1b888a4d9573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.359121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3ad2-d92f-464e-a006-1b888a4d9573 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.364028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 271/516] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:53.364812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4403bf-d7e4-4a26-8c34-1db026c66c66 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.371923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 246/517] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:53.372767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa3ad2-d92f-464e-a006-1b888a4d9573 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.464881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4403bf-d7e4-4a26-8c34-1db026c66c66 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.466453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa3ad2-d92f-464e-a006-1b888a4d9573 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.495256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc44a2c-0b22-48f7-905f-400feba6779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.496037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc44a2c-0b22-48f7-905f-400feba6779d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.496327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc44a2c-0b22-48f7-905f-400feba6779d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.496594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc44a2c-0b22-48f7-905f-400feba6779d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.497686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642315fc-9207-46b3-aab2-f457ead8a205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.498383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642315fc-9207-46b3-aab2-f457ead8a205 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.498666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642315fc-9207-46b3-aab2-f457ead8a205 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.498943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642315fc-9207-46b3-aab2-f457ead8a205 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.499658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642315fc-9207-46b3-aab2-f457ead8a205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:53.499961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642315fc-9207-46b3-aab2-f457ead8a205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.501345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642315fc-9207-46b3-aab2-f457ead8a205 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.504362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc44a2c-0b22-48f7-905f-400feba6779d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.505781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc44a2c-0b22-48f7-905f-400feba6779d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.512506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 247/518] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:53.513283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642315fc-9207-46b3-aab2-f457ead8a205 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-adc44a2c-0b22-48f7-905f-400feba6779d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:55:53.519842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:53.521045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 272/519] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:53.522098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc44a2c-0b22-48f7-905f-400feba6779d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.608524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642315fc-9207-46b3-aab2-f457ead8a205 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.623329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc44a2c-0b22-48f7-905f-400feba6779d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.639864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff158c8-d6df-4855-b82a-1032a691d210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.640645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff158c8-d6df-4855-b82a-1032a691d210 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.640924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff158c8-d6df-4855-b82a-1032a691d210 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.641193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff158c8-d6df-4855-b82a-1032a691d210 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.648288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff158c8-d6df-4855-b82a-1032a691d210 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.649725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff158c8-d6df-4855-b82a-1032a691d210 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.654173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22084a-e097-494e-b6a3-23952da99c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.655021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22084a-e097-494e-b6a3-23952da99c15 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.655303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22084a-e097-494e-b6a3-23952da99c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.655578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22084a-e097-494e-b6a3-23952da99c15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.662425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22084a-e097-494e-b6a3-23952da99c15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.663852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22084a-e097-494e-b6a3-23952da99c15 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9ff158c8-d6df-4855-b82a-1032a691d210 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:55:53.663961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:53.664936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 248/520] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:53.665939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff158c8-d6df-4855-b82a-1032a691d210 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-ee22084a-e097-494e-b6a3-23952da99c15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:55:53.683129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:53.684282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 273/521] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:53.685228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22084a-e097-494e-b6a3-23952da99c15 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.764423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff158c8-d6df-4855-b82a-1032a691d210 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.778224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22084a-e097-494e-b6a3-23952da99c15 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.796371 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd4a4b-4683-49dc-b089-61317d061b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.797034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4a4b-4683-49dc-b089-61317d061b14 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.797317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4a4b-4683-49dc-b089-61317d061b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.797592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd4a4b-4683-49dc-b089-61317d061b14 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.798317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd4a4b-4683-49dc-b089-61317d061b14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.799894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd4a4b-4683-49dc-b089-61317d061b14 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.809809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac1c70-1512-4d75-b087-19d529ab1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.810616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac1c70-1512-4d75-b087-19d529ab1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.810908 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac1c70-1512-4d75-b087-19d529ab1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.811168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac1c70-1512-4d75-b087-19d529ab1fe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.817583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac1c70-1512-4d75-b087-19d529ab1fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.823705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac1c70-1512-4d75-b087-19d529ab1fe5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-97ac1c70-1512-4d75-b087-19d529ab1fe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:55:53.832727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:53.833734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 274/522] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:53.839718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac1c70-1512-4d75-b087-19d529ab1fe5 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.893919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 249/523] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:55:53 2022] POST /identity/v3/users => generated 247 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:55:53.894767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd4a4b-4683-49dc-b089-61317d061b14 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:53.931669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac1c70-1512-4d75-b087-19d529ab1fe5 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:53.966246 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c4bcb-feb7-4606-a97b-a9dbd93eb0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:53.967083 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c4bcb-feb7-4606-a97b-a9dbd93eb0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:53.967466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c4bcb-feb7-4606-a97b-a9dbd93eb0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:53.967937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c4bcb-feb7-4606-a97b-a9dbd93eb0b6 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:53.968771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c4bcb-feb7-4606-a97b-a9dbd93eb0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:53.969202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c4bcb-feb7-4606-a97b-a9dbd93eb0b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:53.971430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c4bcb-feb7-4606-a97b-a9dbd93eb0b6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.002103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd4a4b-4683-49dc-b089-61317d061b14 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:54.009612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 275/524] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:54.010658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c4bcb-feb7-4606-a97b-a9dbd93eb0b6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:54.038507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644c826-5ba1-4596-8595-728629272f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:54.039334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644c826-5ba1-4596-8595-728629272f62 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:54.039715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644c826-5ba1-4596-8595-728629272f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:54.040082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644c826-5ba1-4596-8595-728629272f62 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:54.041045 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644c826-5ba1-4596-8595-728629272f62 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:54.041467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644c826-5ba1-4596-8595-728629272f62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:54.043072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644c826-5ba1-4596-8595-728629272f62 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.065986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 250/525] 10.222.0.44 () {56 vars in 1139 bytes} [Mon May 16 14:55:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:54.065986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644c826-5ba1-4596-8595-728629272f62 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:54.113447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c4bcb-feb7-4606-a97b-a9dbd93eb0b6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:54.147830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd959-c2df-4e50-a46d-45fdb02351e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:54.148500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd959-c2df-4e50-a46d-45fdb02351e1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:54.148779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd959-c2df-4e50-a46d-45fdb02351e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:54.149067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd959-c2df-4e50-a46d-45fdb02351e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:54.149842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd959-c2df-4e50-a46d-45fdb02351e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:54.150181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd959-c2df-4e50-a46d-45fdb02351e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:54.151630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd959-c2df-4e50-a46d-45fdb02351e1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.170386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 276/526] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:54.170386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd959-c2df-4e50-a46d-45fdb02351e1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:54.176350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644c826-5ba1-4596-8595-728629272f62 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:54.212520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ca00c-d6d0-44c5-b71f-30ef19c45f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:54.213313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ca00c-d6d0-44c5-b71f-30ef19c45f43 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:54.213990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ca00c-d6d0-44c5-b71f-30ef19c45f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:54.213990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ca00c-d6d0-44c5-b71f-30ef19c45f43 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:54.214846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ca00c-d6d0-44c5-b71f-30ef19c45f43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:54.215196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ca00c-d6d0-44c5-b71f-30ef19c45f43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:54.216757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ca00c-d6d0-44c5-b71f-30ef19c45f43 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.235611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 251/527] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:54.236566 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ca00c-d6d0-44c5-b71f-30ef19c45f43 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:54.277947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd959-c2df-4e50-a46d-45fdb02351e1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:54.310229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef9ddb-da30-41f0-baeb-48af82f7ca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:54.311030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef9ddb-da30-41f0-baeb-48af82f7ca11 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:54.311407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef9ddb-da30-41f0-baeb-48af82f7ca11 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:54.311789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef9ddb-da30-41f0-baeb-48af82f7ca11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:54.337703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ca00c-d6d0-44c5-b71f-30ef19c45f43 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:54.370704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843d2b6-d51f-444a-9d84-bdca3f044f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:54.371872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d2b6-d51f-444a-9d84-bdca3f044f6d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:54.372227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d2b6-d51f-444a-9d84-bdca3f044f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:54.372767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d2b6-d51f-444a-9d84-bdca3f044f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:54.378917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef9ddb-da30-41f0-baeb-48af82f7ca11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:54.380486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef9ddb-da30-41f0-baeb-48af82f7ca11 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.444717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843d2b6-d51f-444a-9d84-bdca3f044f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:54.446189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843d2b6-d51f-444a-9d84-bdca3f044f6d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.478862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 277/528] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:54.480020 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef9ddb-da30-41f0-baeb-48af82f7ca11 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:54.546848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 252/529] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:54.546848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843d2b6-d51f-444a-9d84-bdca3f044f6d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:54.575858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef9ddb-da30-41f0-baeb-48af82f7ca11 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:54.607513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95764c-8be9-46f2-a0e7-2a10252f0ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:54.608157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95764c-8be9-46f2-a0e7-2a10252f0ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:54.608429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95764c-8be9-46f2-a0e7-2a10252f0ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:54.608693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95764c-8be9-46f2-a0e7-2a10252f0ec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:54.609507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95764c-8be9-46f2-a0e7-2a10252f0ec1 None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=d9237b353da546989b399ee9702d1bd8) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:54.609812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95764c-8be9-46f2-a0e7-2a10252f0ec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:54.611800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95764c-8be9-46f2-a0e7-2a10252f0ec1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.626103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 278/530] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/role_assignments?user.id=d9237b353da546989b399ee9702d1bd8&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:54.626103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95764c-8be9-46f2-a0e7-2a10252f0ec1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:54.642445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843d2b6-d51f-444a-9d84-bdca3f044f6d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:54.678106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cca37-9840-4024-874d-8135bc847c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:54.678819 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cca37-9840-4024-874d-8135bc847c89 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:54.679099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cca37-9840-4024-874d-8135bc847c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:54.679373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cca37-9840-4024-874d-8135bc847c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:54.680203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cca37-9840-4024-874d-8135bc847c89 None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=dc19a5d9ce774f39aa49ab7c64ba682e) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:54.680517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cca37-9840-4024-874d-8135bc847c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:54.681964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cca37-9840-4024-874d-8135bc847c89 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.688548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 253/531] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/role_assignments?user.id=dc19a5d9ce774f39aa49ab7c64ba682e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:54.690064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cca37-9840-4024-874d-8135bc847c89 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:54.784162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95764c-8be9-46f2-a0e7-2a10252f0ec1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:54.803808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cca37-9840-4024-874d-8135bc847c89 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:54.847950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4355-0590-4b17-add7-17e26ada4351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:54.848675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4355-0590-4b17-add7-17e26ada4351 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:54.848952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4355-0590-4b17-add7-17e26ada4351 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:54.849220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4355-0590-4b17-add7-17e26ada4351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:54.863961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4355-0590-4b17-add7-17e26ada4351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:54.866290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4355-0590-4b17-add7-17e26ada4351 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.867183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b2c62-d48b-4f7c-80a1-fc8524961bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:54.867991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b2c62-d48b-4f7c-80a1-fc8524961bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:54.868270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b2c62-d48b-4f7c-80a1-fc8524961bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:54.868538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b2c62-d48b-4f7c-80a1-fc8524961bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:54.880508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b2c62-d48b-4f7c-80a1-fc8524961bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:54.881983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b2c62-d48b-4f7c-80a1-fc8524961bb3 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-862c4355-0590-4b17-add7-17e26ada4351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:54.888969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:54.890180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:54.891151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:54.891151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:54.891151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:54.891151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:54.898145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 254/532] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:54.899784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4355-0590-4b17-add7-17e26ada4351 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-923b2c62-d48b-4f7c-80a1-fc8524961bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:54.902205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:54.903302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:54.904365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:54.904365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:54.904365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:54.904365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:54.908975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 279/533] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:54.910159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b2c62-d48b-4f7c-80a1-fc8524961bb3 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:55.034109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4355-0590-4b17-add7-17e26ada4351 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:55.066684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c279f-2c4a-4470-a5d5-2b2560ab685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:55.067353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c279f-2c4a-4470-a5d5-2b2560ab685c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:55.067635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c279f-2c4a-4470-a5d5-2b2560ab685c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:55.067910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c279f-2c4a-4470-a5d5-2b2560ab685c None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:55.068792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c279f-2c4a-4470-a5d5-2b2560ab685c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:55.069100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c279f-2c4a-4470-a5d5-2b2560ab685c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:55.070877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c279f-2c4a-4470-a5d5-2b2560ab685c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:55.076337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b2c62-d48b-4f7c-80a1-fc8524961bb3 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:55.090907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 255/534] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:55:55.103451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c279f-2c4a-4470-a5d5-2b2560ab685c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:55.146712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ab869-54ab-4614-898b-a248db1845d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:55.147615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ab869-54ab-4614-898b-a248db1845d8 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:55.148046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ab869-54ab-4614-898b-a248db1845d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:55.148464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ab869-54ab-4614-898b-a248db1845d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:55.149450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ab869-54ab-4614-898b-a248db1845d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:55.150919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ab869-54ab-4614-898b-a248db1845d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:55.152478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ab869-54ab-4614-898b-a248db1845d8 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:55.172471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 280/535] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:55.181947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ab869-54ab-4614-898b-a248db1845d8 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:55.274455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c279f-2c4a-4470-a5d5-2b2560ab685c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:55.312442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb17e-4cc1-4413-b674-8cd98a3ede0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:55.320772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb17e-4cc1-4413-b674-8cd98a3ede0b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:55.320772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb17e-4cc1-4413-b674-8cd98a3ede0b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:55.320772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb17e-4cc1-4413-b674-8cd98a3ede0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:55.322534 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eb17e-4cc1-4413-b674-8cd98a3ede0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:55.324836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eb17e-4cc1-4413-b674-8cd98a3ede0b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-596eb17e-4cc1-4413-b674-8cd98a3ede0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:55:55.341065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:55.341925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:55.342805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:55:55.342805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:55:55.342805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:55:55.342805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:55:55.342805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:55:55.342805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:55:55.342805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:55.342805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:55.347194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 256/536] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:55.348434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb17e-4cc1-4413-b674-8cd98a3ede0b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:55.385747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ab869-54ab-4614-898b-a248db1845d8 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:55.448411 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75a97-e921-48ef-9f96-a889f5575845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:55.449208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75a97-e921-48ef-9f96-a889f5575845 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:55.449485 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75a97-e921-48ef-9f96-a889f5575845 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:55.449755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75a97-e921-48ef-9f96-a889f5575845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:55.463412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c75a97-e921-48ef-9f96-a889f5575845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:55.464900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c75a97-e921-48ef-9f96-a889f5575845 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:55.488313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb17e-4cc1-4413-b674-8cd98a3ede0b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-a9c75a97-e921-48ef-9f96-a889f5575845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:55:55.495802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:55.496650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:55.498146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:55:55.498146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:55:55.498146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:55:55.498146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:55:55.498146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:55:55.498146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:55:55.498146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:55.498146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:55.498146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 281/537] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:55.503089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75a97-e921-48ef-9f96-a889f5575845 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:55.523911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64456bba-9f07-4f3e-bf73-95573c4c267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:55.524575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64456bba-9f07-4f3e-bf73-95573c4c267b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:55.524852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64456bba-9f07-4f3e-bf73-95573c4c267b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:55.525121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64456bba-9f07-4f3e-bf73-95573c4c267b None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:55.525908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64456bba-9f07-4f3e-bf73-95573c4c267b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:55.526242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64456bba-9f07-4f3e-bf73-95573c4c267b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:55.527678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64456bba-9f07-4f3e-bf73-95573c4c267b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:55.551889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 257/538] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:55.559234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64456bba-9f07-4f3e-bf73-95573c4c267b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:55.651899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75a97-e921-48ef-9f96-a889f5575845 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:55.688500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67805f7f-40a5-43ff-b3d4-a8bb6b02c852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:55.689805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67805f7f-40a5-43ff-b3d4-a8bb6b02c852 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:55.690287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67805f7f-40a5-43ff-b3d4-a8bb6b02c852 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:55.690567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67805f7f-40a5-43ff-b3d4-a8bb6b02c852 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:55.691350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67805f7f-40a5-43ff-b3d4-a8bb6b02c852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:55.691659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67805f7f-40a5-43ff-b3d4-a8bb6b02c852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:55.696085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67805f7f-40a5-43ff-b3d4-a8bb6b02c852 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:55.708260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 282/539] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:55.713818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67805f7f-40a5-43ff-b3d4-a8bb6b02c852 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:55.803956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64456bba-9f07-4f3e-bf73-95573c4c267b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:55.838149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67805f7f-40a5-43ff-b3d4-a8bb6b02c852 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:55.875279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e20896-fd70-4956-a8b5-36efcf6d0cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:55.876087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e20896-fd70-4956-a8b5-36efcf6d0cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:55.876368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e20896-fd70-4956-a8b5-36efcf6d0cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:55.877149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e20896-fd70-4956-a8b5-36efcf6d0cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:55.877978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e20896-fd70-4956-a8b5-36efcf6d0cb9 None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=55591aa3b6324ce99d1529beb8f6de2b) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:55.878331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e20896-fd70-4956-a8b5-36efcf6d0cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:55.880273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e20896-fd70-4956-a8b5-36efcf6d0cb9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:55.886200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 283/540] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:55 2022] GET /identity/v3/role_assignments?user.id=55591aa3b6324ce99d1529beb8f6de2b&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:55.889472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc154c7-ab3f-46fd-b327-d5d2bb922a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:55.890247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc154c7-ab3f-46fd-b327-d5d2bb922a5e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:55.890595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc154c7-ab3f-46fd-b327-d5d2bb922a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:55.890933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc154c7-ab3f-46fd-b327-d5d2bb922a5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:55.891913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc154c7-ab3f-46fd-b327-d5d2bb922a5e None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=aec8440b7bd84c2b9ce583a01adabf90) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:55.892358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc154c7-ab3f-46fd-b327-d5d2bb922a5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:55.893919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc154c7-ab3f-46fd-b327-d5d2bb922a5e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:55.900634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 258/541] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:55 2022] GET /identity/v3/role_assignments?user.id=aec8440b7bd84c2b9ce583a01adabf90&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 259 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:56.317822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38956-75bc-4bb6-8cfa-14d161afbad6 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:56.320428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38956-75bc-4bb6-8cfa-14d161afbad6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:56.320428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38956-75bc-4bb6-8cfa-14d161afbad6 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:56.320428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 284/542] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:56.325022 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6246a4-81ac-46bc-925e-9f28c7da6ccc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:56.325540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6246a4-81ac-46bc-925e-9f28c7da6ccc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:56.326012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6246a4-81ac-46bc-925e-9f28c7da6ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:56.344367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0a6246a4-81ac-46bc-925e-9f28c7da6ccc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:56.346203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0a6246a4-81ac-46bc-925e-9f28c7da6ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:56.438402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 259/543] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:56.466996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38956-75bc-4bb6-8cfa-14d161afbad6 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:56.587752 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38956-75bc-4bb6-8cfa-14d161afbad6 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:56.622049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c296a8-19b0-41ba-a07d-7ee0961de334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:56.623218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c296a8-19b0-41ba-a07d-7ee0961de334 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:56.623709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c296a8-19b0-41ba-a07d-7ee0961de334 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:56.624180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c296a8-19b0-41ba-a07d-7ee0961de334 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:56.635171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c296a8-19b0-41ba-a07d-7ee0961de334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-23c296a8-19b0-41ba-a07d-7ee0961de334 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:56.643940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:56.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:56.645641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:56.648371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 285/544] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:56.655142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6246a4-81ac-46bc-925e-9f28c7da6ccc None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:56.804823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6246a4-81ac-46bc-925e-9f28c7da6ccc None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:56.848286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6aba1-9874-434a-a4a8-6d7b8dfc9ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:56.848950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6aba1-9874-434a-a4a8-6d7b8dfc9ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:56.849226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6aba1-9874-434a-a4a8-6d7b8dfc9ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:56.849494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6aba1-9874-434a-a4a8-6d7b8dfc9ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:56.850261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6aba1-9874-434a-a4a8-6d7b8dfc9ac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:56.850563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6aba1-9874-434a-a4a8-6d7b8dfc9ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:56.851938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6aba1-9874-434a-a4a8-6d7b8dfc9ac6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:56.864159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 260/545] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:55:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:56.869518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c296a8-19b0-41ba-a07d-7ee0961de334 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:57.007092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c296a8-19b0-41ba-a07d-7ee0961de334 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:57.041633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d088-0f5c-4743-854f-cb86512f5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:57.042825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d088-0f5c-4743-854f-cb86512f5134 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.043323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d088-0f5c-4743-854f-cb86512f5134 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.043793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d088-0f5c-4743-854f-cb86512f5134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.056519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445d088-0f5c-4743-854f-cb86512f5134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:57.058435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445d088-0f5c-4743-854f-cb86512f5134 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c445d088-0f5c-4743-854f-cb86512f5134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:57.078144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:57.079085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:57.079986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:57.079986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:57.079986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:57.079986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:57.082405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 286/546] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:57.094100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6aba1-9874-434a-a4a8-6d7b8dfc9ac6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:57.256411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6aba1-9874-434a-a4a8-6d7b8dfc9ac6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:57.294946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd2dca-ae0b-4214-af8a-33421335ff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:57.295620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2dca-ae0b-4214-af8a-33421335ff6b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.295904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2dca-ae0b-4214-af8a-33421335ff6b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.296180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd2dca-ae0b-4214-af8a-33421335ff6b None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.296904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd2dca-ae0b-4214-af8a-33421335ff6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:57.297209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd2dca-ae0b-4214-af8a-33421335ff6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:57.299323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd2dca-ae0b-4214-af8a-33421335ff6b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:57.316719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 261/547] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:57.322168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d088-0f5c-4743-854f-cb86512f5134 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:57.336055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1e76a-b570-492f-9c42-7f1ee1a8b377 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.336341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1e76a-b570-492f-9c42-7f1ee1a8b377 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.336872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1e76a-b570-492f-9c42-7f1ee1a8b377 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.341910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 262/548] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:55:57.343520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892701b7-f86c-4e8d-a2aa-5e902f6d32e9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.343808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892701b7-f86c-4e8d-a2aa-5e902f6d32e9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.344085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892701b7-f86c-4e8d-a2aa-5e902f6d32e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.360473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-892701b7-f86c-4e8d-a2aa-5e902f6d32e9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:57.361732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-892701b7-f86c-4e8d-a2aa-5e902f6d32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:57.450788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 263/549] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:57.452913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6929b-c38d-4d55-aa47-3af304d8463e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.453208 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6929b-c38d-4d55-aa47-3af304d8463e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.453488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6929b-c38d-4d55-aa47-3af304d8463e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.460228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 264/550] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:57.463622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee170-e602-4aaa-aced-6ac816c54576 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.463913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee170-e602-4aaa-aced-6ac816c54576 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.464190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee170-e602-4aaa-aced-6ac816c54576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.468131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d088-0f5c-4743-854f-cb86512f5134 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:57.491620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1b7ee170-e602-4aaa-aced-6ac816c54576 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:57.492880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1b7ee170-e602-4aaa-aced-6ac816c54576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:57.508351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89494987-928c-4ead-8b30-0a6a3b40fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:57.509144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89494987-928c-4ead-8b30-0a6a3b40fae8 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.509423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89494987-928c-4ead-8b30-0a6a3b40fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.509697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89494987-928c-4ead-8b30-0a6a3b40fae8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.517221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89494987-928c-4ead-8b30-0a6a3b40fae8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:57.519379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89494987-928c-4ead-8b30-0a6a3b40fae8 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-89494987-928c-4ead-8b30-0a6a3b40fae8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:55:57.533376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:57.534329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 14:55:57.535206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:57.539310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 287/551] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:55:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:57.540173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89494987-928c-4ead-8b30-0a6a3b40fae8 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:57.563428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 265/552] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:57.564404 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee170-e602-4aaa-aced-6ac816c54576 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:57.662244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee170-e602-4aaa-aced-6ac816c54576 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:57.679398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89494987-928c-4ead-8b30-0a6a3b40fae8 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:57.702567 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43534d1-b0c7-46af-9a3f-16e07be32f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:57.703527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43534d1-b0c7-46af-9a3f-16e07be32f9b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.703811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43534d1-b0c7-46af-9a3f-16e07be32f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.704242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43534d1-b0c7-46af-9a3f-16e07be32f9b None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.705424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43534d1-b0c7-46af-9a3f-16e07be32f9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:57.706019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43534d1-b0c7-46af-9a3f-16e07be32f9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:57.708013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43534d1-b0c7-46af-9a3f-16e07be32f9b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:57.712341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef57138-b87a-464b-9a53-0f3a33be494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:57.713123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef57138-b87a-464b-9a53-0f3a33be494b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.713397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef57138-b87a-464b-9a53-0f3a33be494b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.713661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef57138-b87a-464b-9a53-0f3a33be494b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.726518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 266/553] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 16 14:55:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:57.727333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43534d1-b0c7-46af-9a3f-16e07be32f9b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:57.732953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef57138-b87a-464b-9a53-0f3a33be494b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-aef57138-b87a-464b-9a53-0f3a33be494b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:57.741095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:57.742199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 288/554] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:57.743554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef57138-b87a-464b-9a53-0f3a33be494b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:57.841537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef57138-b87a-464b-9a53-0f3a33be494b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:57.853021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43534d1-b0c7-46af-9a3f-16e07be32f9b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:57.873663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8431d6a-968c-4832-a99f-f651b193fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:57.874378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8431d6a-968c-4832-a99f-f651b193fea6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.874657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8431d6a-968c-4832-a99f-f651b193fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.874923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8431d6a-968c-4832-a99f-f651b193fea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.894820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24749e04-6db9-4dc3-ae66-e4383a8ce445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:57.895652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24749e04-6db9-4dc3-ae66-e4383a8ce445 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:57.895933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24749e04-6db9-4dc3-ae66-e4383a8ce445 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:57.896635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24749e04-6db9-4dc3-ae66-e4383a8ce445 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:57.910473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24749e04-6db9-4dc3-ae66-e4383a8ce445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-24749e04-6db9-4dc3-ae66-e4383a8ce445 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:57.920758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:57.922880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:57.925406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:57.934288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 267/555] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:57.934288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24749e04-6db9-4dc3-ae66-e4383a8ce445 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:57.944987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8431d6a-968c-4832-a99f-f651b193fea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:57.946535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8431d6a-968c-4832-a99f-f651b193fea6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.041144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24749e04-6db9-4dc3-ae66-e4383a8ce445 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.073742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44530600-8f0d-4653-9252-e659e95733cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.079468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530600-8f0d-4653-9252-e659e95733cf None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.079862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 289/556] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:55:58.080703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530600-8f0d-4653-9252-e659e95733cf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.081129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44530600-8f0d-4653-9252-e659e95733cf None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.081283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8431d6a-968c-4832-a99f-f651b193fea6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.082567 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44530600-8f0d-4653-9252-e659e95733cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:58.083041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44530600-8f0d-4653-9252-e659e95733cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.084592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44530600-8f0d-4653-9252-e659e95733cf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.093364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 268/557] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:55:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:58.098848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44530600-8f0d-4653-9252-e659e95733cf None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.196572 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44530600-8f0d-4653-9252-e659e95733cf None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.204478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8431d6a-968c-4832-a99f-f651b193fea6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.231169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5556f1-a436-4025-8577-c872393e8d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.232189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5556f1-a436-4025-8577-c872393e8d0c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.232609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5556f1-a436-4025-8577-c872393e8d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.233040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5556f1-a436-4025-8577-c872393e8d0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.244497 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5556f1-a436-4025-8577-c872393e8d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.245997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758449c6-d219-4b78-a26f-6c4b60481007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.246570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5556f1-a436-4025-8577-c872393e8d0c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.246824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758449c6-d219-4b78-a26f-6c4b60481007 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.247176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758449c6-d219-4b78-a26f-6c4b60481007 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.247559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758449c6-d219-4b78-a26f-6c4b60481007 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.248360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758449c6-d219-4b78-a26f-6c4b60481007 None admin] RBAC: Adding query filter params (name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:58.248738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758449c6-d219-4b78-a26f-6c4b60481007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.250751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758449c6-d219-4b78-a26f-6c4b60481007 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-6a5556f1-a436-4025-8577-c872393e8d0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:58.265008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:58.266085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:58.266907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:58.266907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:58.266907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:58.266907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:58.267120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 290/558] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:58.267120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758449c6-d219-4b78-a26f-6c4b60481007 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.269103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 269/559] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:58.270015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5556f1-a436-4025-8577-c872393e8d0c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.381600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5556f1-a436-4025-8577-c872393e8d0c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.387814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758449c6-d219-4b78-a26f-6c4b60481007 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.424583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8541e-1082-44e9-9584-a1714c4c85d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.425532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8541e-1082-44e9-9584-a1714c4c85d6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.425837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8541e-1082-44e9-9584-a1714c4c85d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.426146 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8541e-1082-44e9-9584-a1714c4c85d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.431609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927a13-4b59-4d89-9f3b-7cda3850f672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.432660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927a13-4b59-4d89-9f3b-7cda3850f672 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.433076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927a13-4b59-4d89-9f3b-7cda3850f672 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.433507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927a13-4b59-4d89-9f3b-7cda3850f672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.438595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8541e-1082-44e9-9584-a1714c4c85d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.441858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8541e-1082-44e9-9584-a1714c4c85d6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.446678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b927a13-4b59-4d89-9f3b-7cda3850f672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.448410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b927a13-4b59-4d89-9f3b-7cda3850f672 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e3f8541e-1082-44e9-9584-a1714c4c85d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:58.464173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:58.465261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:58.466738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:58.466738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:58.466738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:58.466738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:58.470186 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 270/560] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-3b927a13-4b59-4d89-9f3b-7cda3850f672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:58.471323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:58.472490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:58.473577 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:58.473577 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:58.473577 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:58.473577 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:58.473827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8541e-1082-44e9-9584-a1714c4c85d6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.475365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 291/561] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:58.480827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927a13-4b59-4d89-9f3b-7cda3850f672 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.587044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927a13-4b59-4d89-9f3b-7cda3850f672 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.597730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8541e-1082-44e9-9584-a1714c4c85d6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.624057 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcda9e-946e-4fa5-8bc9-041e6e72c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.624844 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcda9e-946e-4fa5-8bc9-041e6e72c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.625133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcda9e-946e-4fa5-8bc9-041e6e72c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.625549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcda9e-946e-4fa5-8bc9-041e6e72c6d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.626309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcda9e-946e-4fa5-8bc9-041e6e72c6d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:58.627187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcda9e-946e-4fa5-8bc9-041e6e72c6d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.628572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcda9e-946e-4fa5-8bc9-041e6e72c6d4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.631334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840943-a99c-4552-9818-1c9bfdf26ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.632043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840943-a99c-4552-9818-1c9bfdf26ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.632278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840943-a99c-4552-9818-1c9bfdf26ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.632553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840943-a99c-4552-9818-1c9bfdf26ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.633268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840943-a99c-4552-9818-1c9bfdf26ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:58.633575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840943-a99c-4552-9818-1c9bfdf26ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.635010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840943-a99c-4552-9818-1c9bfdf26ec0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.640565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 292/562] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:58.641681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcda9e-946e-4fa5-8bc9-041e6e72c6d4 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.647482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 271/563] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:58.648767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20fbd-2a03-4d2c-8629-87df55492dd8 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.649054 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20fbd-2a03-4d2c-8629-87df55492dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.649356 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20fbd-2a03-4d2c-8629-87df55492dd8 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.651811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 272/564] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:58.653010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c422d-3513-467d-bb78-3c46c4b40754 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.653301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c422d-3513-467d-bb78-3c46c4b40754 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.653583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c422d-3513-467d-bb78-3c46c4b40754 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.655038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 273/565] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:55:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:55:58.655521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c422d-3513-467d-bb78-3c46c4b40754 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.734789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcda9e-946e-4fa5-8bc9-041e6e72c6d4 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.749315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c422d-3513-467d-bb78-3c46c4b40754 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.765572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37da2ad-6ddd-4395-88ad-424caede804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.766255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37da2ad-6ddd-4395-88ad-424caede804a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.766532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37da2ad-6ddd-4395-88ad-424caede804a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.766799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37da2ad-6ddd-4395-88ad-424caede804a None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.768059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37da2ad-6ddd-4395-88ad-424caede804a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:58.768361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37da2ad-6ddd-4395-88ad-424caede804a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.769712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37da2ad-6ddd-4395-88ad-424caede804a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.780214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 293/566] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:58.780411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bca9da-03b9-4fc0-b347-801f25d2e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.780807 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37da2ad-6ddd-4395-88ad-424caede804a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.781281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bca9da-03b9-4fc0-b347-801f25d2e84f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.781570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bca9da-03b9-4fc0-b347-801f25d2e84f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.781845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bca9da-03b9-4fc0-b347-801f25d2e84f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.789419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bca9da-03b9-4fc0-b347-801f25d2e84f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.790880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bca9da-03b9-4fc0-b347-801f25d2e84f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-21bca9da-03b9-4fc0-b347-801f25d2e84f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:55:58.804725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:58.805836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:55:58.806972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 274/567] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:58.807751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909e1ec-a49d-4d57-97dd-5c40b9b9c4aa None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.807751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909e1ec-a49d-4d57-97dd-5c40b9b9c4aa None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.807751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909e1ec-a49d-4d57-97dd-5c40b9b9c4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.823655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f909e1ec-a49d-4d57-97dd-5c40b9b9c4aa None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:58.824828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f909e1ec-a49d-4d57-97dd-5c40b9b9c4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:58.874530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37da2ad-6ddd-4395-88ad-424caede804a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:58.886440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 275/568] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:58.887616 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedde3d0-ce26-4fff-bada-1d4695ef36c3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.888516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedde3d0-ce26-4fff-bada-1d4695ef36c3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.888516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedde3d0-ce26-4fff-bada-1d4695ef36c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.903768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cedde3d0-ce26-4fff-bada-1d4695ef36c3 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:55:58.904923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cedde3d0-ce26-4fff-bada-1d4695ef36c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:55:58.907110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6790a-3047-4cc3-b2dd-d104bba44a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:58.907960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6790a-3047-4cc3-b2dd-d104bba44a09 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:58.908242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6790a-3047-4cc3-b2dd-d104bba44a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:58.908514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6790a-3047-4cc3-b2dd-d104bba44a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:58.915059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6790a-3047-4cc3-b2dd-d104bba44a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:58.916497 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6790a-3047-4cc3-b2dd-d104bba44a09 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c9f6790a-3047-4cc3-b2dd-d104bba44a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:55:58.930279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:58.931300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:58.932304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:55:58.932304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:55:58.932304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:55:58.932304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:55:58.932304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:55:58.932304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:55:58.932304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:55:58.932304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:58.932304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 294/569] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:58.932880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6790a-3047-4cc3-b2dd-d104bba44a09 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:58.968665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 276/570] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:55:58.969334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedde3d0-ce26-4fff-bada-1d4695ef36c3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.026157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6790a-3047-4cc3-b2dd-d104bba44a09 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.057595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0f110-ab2c-4607-977e-1408d587c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.058406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0f110-ab2c-4607-977e-1408d587c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.058689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0f110-ab2c-4607-977e-1408d587c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.058962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0f110-ab2c-4607-977e-1408d587c8a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.066250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0f110-ab2c-4607-977e-1408d587c8a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.066587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedde3d0-ce26-4fff-bada-1d4695ef36c3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.067679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0f110-ab2c-4607-977e-1408d587c8a6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c5c0f110-ab2c-4607-977e-1408d587c8a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:55:59.081664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:59.082886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 295/571] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:59.084466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0f110-ab2c-4607-977e-1408d587c8a6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.102111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd179e-7e7b-43c5-9cf3-d2e4c113b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.102897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd179e-7e7b-43c5-9cf3-d2e4c113b687 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.103277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd179e-7e7b-43c5-9cf3-d2e4c113b687 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.103647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd179e-7e7b-43c5-9cf3-d2e4c113b687 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.104641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd179e-7e7b-43c5-9cf3-d2e4c113b687 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:59.105020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd179e-7e7b-43c5-9cf3-d2e4c113b687 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.106545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd179e-7e7b-43c5-9cf3-d2e4c113b687 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.123126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 277/572] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 16 14:55:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:59.123901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd179e-7e7b-43c5-9cf3-d2e4c113b687 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.174727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0f110-ab2c-4607-977e-1408d587c8a6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.205786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb299b-4d7d-49f5-a921-eac82a771adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.206605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb299b-4d7d-49f5-a921-eac82a771adc None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.206880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb299b-4d7d-49f5-a921-eac82a771adc None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.207152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb299b-4d7d-49f5-a921-eac82a771adc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.214515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd179e-7e7b-43c5-9cf3-d2e4c113b687 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.217078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb299b-4d7d-49f5-a921-eac82a771adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-49fb299b-4d7d-49f5-a921-eac82a771adc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:59.224719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:59.225800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 296/573] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:59.226962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb299b-4d7d-49f5-a921-eac82a771adc None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.250003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1be8c9-8240-4f63-855c-21cf72164ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.250683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1be8c9-8240-4f63-855c-21cf72164ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.250963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1be8c9-8240-4f63-855c-21cf72164ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.251235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1be8c9-8240-4f63-855c-21cf72164ca0 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.252613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1be8c9-8240-4f63-855c-21cf72164ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:59.252915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1be8c9-8240-4f63-855c-21cf72164ca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.254383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1be8c9-8240-4f63-855c-21cf72164ca0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.265077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 278/574] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:59.265836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1be8c9-8240-4f63-855c-21cf72164ca0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.325545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb299b-4d7d-49f5-a921-eac82a771adc None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.356871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf8a37-9f01-4120-98f0-bbd1963ad3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.357653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf8a37-9f01-4120-98f0-bbd1963ad3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.357931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf8a37-9f01-4120-98f0-bbd1963ad3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.358236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf8a37-9f01-4120-98f0-bbd1963ad3e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.358356 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1be8c9-8240-4f63-855c-21cf72164ca0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.368291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf8a37-9f01-4120-98f0-bbd1963ad3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-4bcf8a37-9f01-4120-98f0-bbd1963ad3e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:55:59.375872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:59.377550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 297/575] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:59.378638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf8a37-9f01-4120-98f0-bbd1963ad3e3 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.412697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3a533-9711-4fb5-b76a-538946603439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.413361 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a533-9711-4fb5-b76a-538946603439 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.413641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a533-9711-4fb5-b76a-538946603439 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.413911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a533-9711-4fb5-b76a-538946603439 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.414770 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3a533-9711-4fb5-b76a-538946603439 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:59.415074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3a533-9711-4fb5-b76a-538946603439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.416484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3a533-9711-4fb5-b76a-538946603439 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.433018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 279/576] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:59.433720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3a533-9711-4fb5-b76a-538946603439 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.471033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf8a37-9f01-4120-98f0-bbd1963ad3e3 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.501902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0897854-088f-4efc-b0fe-c61a69a698d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.502694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0897854-088f-4efc-b0fe-c61a69a698d5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.502973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0897854-088f-4efc-b0fe-c61a69a698d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.503246 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0897854-088f-4efc-b0fe-c61a69a698d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.513121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0897854-088f-4efc-b0fe-c61a69a698d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.514578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0897854-088f-4efc-b0fe-c61a69a698d5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.528121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3a533-9711-4fb5-b76a-538946603439 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c0897854-088f-4efc-b0fe-c61a69a698d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:59.530864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:59.531893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:59.532759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:59.532759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:59.532759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:59.532759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:59.532759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 298/577] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:59.533548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0897854-088f-4efc-b0fe-c61a69a698d5 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.560935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa8aa-136a-4b39-a0e1-041df1dd9b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.561622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa8aa-136a-4b39-a0e1-041df1dd9b80 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.561884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa8aa-136a-4b39-a0e1-041df1dd9b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.562196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aa8aa-136a-4b39-a0e1-041df1dd9b80 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.562936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aa8aa-136a-4b39-a0e1-041df1dd9b80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:59.563238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aa8aa-136a-4b39-a0e1-041df1dd9b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.564597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1aa8aa-136a-4b39-a0e1-041df1dd9b80 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.572110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 280/578] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:59.572876 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa8aa-136a-4b39-a0e1-041df1dd9b80 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.625329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0897854-088f-4efc-b0fe-c61a69a698d5 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.655933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94f4d1-f73c-4dda-b51c-437ae104faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.656572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94f4d1-f73c-4dda-b51c-437ae104faf0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.656852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94f4d1-f73c-4dda-b51c-437ae104faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.657126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94f4d1-f73c-4dda-b51c-437ae104faf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.658483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94f4d1-f73c-4dda-b51c-437ae104faf0 None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=6a6668cb0bda4d61b6b96f547a422830) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:59.658793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94f4d1-f73c-4dda-b51c-437ae104faf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.660215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94f4d1-f73c-4dda-b51c-437ae104faf0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.665364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 299/579] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/role_assignments?user.id=6a6668cb0bda4d61b6b96f547a422830&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:59.666159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94f4d1-f73c-4dda-b51c-437ae104faf0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.666330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1aa8aa-136a-4b39-a0e1-041df1dd9b80 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.702130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f9e82-3b2c-4896-a2af-c8b32c3c3866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.702739 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9e82-3b2c-4896-a2af-c8b32c3c3866 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.703024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9e82-3b2c-4896-a2af-c8b32c3c3866 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.703304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9e82-3b2c-4896-a2af-c8b32c3c3866 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.704068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9e82-3b2c-4896-a2af-c8b32c3c3866 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:59.704379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9e82-3b2c-4896-a2af-c8b32c3c3866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.705803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9e82-3b2c-4896-a2af-c8b32c3c3866 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.719587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 281/580] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:59.719587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f9e82-3b2c-4896-a2af-c8b32c3c3866 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.768680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94f4d1-f73c-4dda-b51c-437ae104faf0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.802706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c7cd-0899-4f00-aafe-a744b75aee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.803514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c7cd-0899-4f00-aafe-a744b75aee8d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.803796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c7cd-0899-4f00-aafe-a744b75aee8d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.804069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c7cd-0899-4f00-aafe-a744b75aee8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.815222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5c7cd-0899-4f00-aafe-a744b75aee8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.816709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5c7cd-0899-4f00-aafe-a744b75aee8d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.820413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f9e82-3b2c-4896-a2af-c8b32c3c3866 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-b3c5c7cd-0899-4f00-aafe-a744b75aee8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:59.834655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:59.835643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:59.836806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:59.836806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:59.836806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:59.836806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:59.836806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 300/581] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:59.837094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c7cd-0899-4f00-aafe-a744b75aee8d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.862246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da8b96-e266-4e25-a7cf-bef3b807cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.862909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da8b96-e266-4e25-a7cf-bef3b807cf95 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.863187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da8b96-e266-4e25-a7cf-bef3b807cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.863455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da8b96-e266-4e25-a7cf-bef3b807cf95 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.864167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da8b96-e266-4e25-a7cf-bef3b807cf95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:55:59.864469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da8b96-e266-4e25-a7cf-bef3b807cf95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.865822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da8b96-e266-4e25-a7cf-bef3b807cf95 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.881612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 282/582] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:55:59.881612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da8b96-e266-4e25-a7cf-bef3b807cf95 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:55:59.933938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c7cd-0899-4f00-aafe-a744b75aee8d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.966381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331981-1a93-4156-9341-fb1797480952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:55:59.967114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331981-1a93-4156-9341-fb1797480952 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:55:59.967400 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331981-1a93-4156-9341-fb1797480952 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:55:59.967665 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331981-1a93-4156-9341-fb1797480952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:55:59.976098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da8b96-e266-4e25-a7cf-bef3b807cf95 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:55:59.978885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38331981-1a93-4156-9341-fb1797480952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:55:59.980338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38331981-1a93-4156-9341-fb1797480952 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-38331981-1a93-4156-9341-fb1797480952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:55:59.996802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:55:59.997944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:55:59.998897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:55:59.998897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:55:59.998897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:55:59.998897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:55:59.998897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 301/583] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:55:59.999180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331981-1a93-4156-9341-fb1797480952 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.016908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e539e-63a0-45a9-b880-f9c05254e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.018248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e539e-63a0-45a9-b880-f9c05254e753 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.018528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e539e-63a0-45a9-b880-f9c05254e753 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.018809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e539e-63a0-45a9-b880-f9c05254e753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.031113 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e539e-63a0-45a9-b880-f9c05254e753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.034262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e539e-63a0-45a9-b880-f9c05254e753 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-8b0e539e-63a0-45a9-b880-f9c05254e753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:00.055147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:00.056072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:00.057065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:00.057065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:00.057065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:00.057065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:00.057065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 283/584] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:00.057338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e539e-63a0-45a9-b880-f9c05254e753 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.102741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331981-1a93-4156-9341-fb1797480952 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.135171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529d57-cc2a-4654-9bd4-79f46cf60b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.135857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529d57-cc2a-4654-9bd4-79f46cf60b8d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.136135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529d57-cc2a-4654-9bd4-79f46cf60b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.136403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529d57-cc2a-4654-9bd4-79f46cf60b8d None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.137117 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529d57-cc2a-4654-9bd4-79f46cf60b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:00.137424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529d57-cc2a-4654-9bd4-79f46cf60b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.138815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529d57-cc2a-4654-9bd4-79f46cf60b8d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.152385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 302/585] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:00.152385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529d57-cc2a-4654-9bd4-79f46cf60b8d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.164165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e539e-63a0-45a9-b880-f9c05254e753 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.196942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29978-6be1-4469-a42f-4a4a43f3e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.197733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29978-6be1-4469-a42f-4a4a43f3e07a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.198010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29978-6be1-4469-a42f-4a4a43f3e07a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.198328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c29978-6be1-4469-a42f-4a4a43f3e07a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.204866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c29978-6be1-4469-a42f-4a4a43f3e07a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.206341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c29978-6be1-4469-a42f-4a4a43f3e07a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-07c29978-6be1-4469-a42f-4a4a43f3e07a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:00.219951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:00.221376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:00.222287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:00.222287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:00.222287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:00.222287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:00.222287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:00.222287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:00.222287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:00.222287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:00.222287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 284/586] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:00.222783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29978-6be1-4469-a42f-4a4a43f3e07a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.252473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529d57-cc2a-4654-9bd4-79f46cf60b8d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.285155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3f3e-3241-4bfd-9483-5b449fc754b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.286024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3f3e-3241-4bfd-9483-5b449fc754b4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.286328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3f3e-3241-4bfd-9483-5b449fc754b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.286595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3f3e-3241-4bfd-9483-5b449fc754b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.287311 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d3f3e-3241-4bfd-9483-5b449fc754b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:00.287611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d3f3e-3241-4bfd-9483-5b449fc754b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.288970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d3f3e-3241-4bfd-9483-5b449fc754b4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.300149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 303/587] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:00.300942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3f3e-3241-4bfd-9483-5b449fc754b4 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.326329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c29978-6be1-4469-a42f-4a4a43f3e07a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.359658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a22daa-df7e-4651-bc8d-d0d05414b9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.360331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a22daa-df7e-4651-bc8d-d0d05414b9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.360617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a22daa-df7e-4651-bc8d-d0d05414b9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.360896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a22daa-df7e-4651-bc8d-d0d05414b9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.362238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a22daa-df7e-4651-bc8d-d0d05414b9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:00.362550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a22daa-df7e-4651-bc8d-d0d05414b9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.363924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a22daa-df7e-4651-bc8d-d0d05414b9d7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.375478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 285/588] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:00.376268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a22daa-df7e-4651-bc8d-d0d05414b9d7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.421127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3f3e-3241-4bfd-9483-5b449fc754b4 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.453026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d8317-d284-473f-83e5-d5e4a546db73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.453822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d8317-d284-473f-83e5-d5e4a546db73 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.454126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d8317-d284-473f-83e5-d5e4a546db73 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.454404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d8317-d284-473f-83e5-d5e4a546db73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.460985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d8317-d284-473f-83e5-d5e4a546db73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.462747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d8317-d284-473f-83e5-d5e4a546db73 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-713d8317-d284-473f-83e5-d5e4a546db73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:00.477048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:00.477915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 304/589] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:00.483721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d8317-d284-473f-83e5-d5e4a546db73 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.484256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a22daa-df7e-4651-bc8d-d0d05414b9d7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.515630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a987610-fb99-4eb3-933c-3094a32df628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.516293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a987610-fb99-4eb3-933c-3094a32df628 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.516575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a987610-fb99-4eb3-933c-3094a32df628 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.516851 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a987610-fb99-4eb3-933c-3094a32df628 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.517657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a987610-fb99-4eb3-933c-3094a32df628 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:00.517967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a987610-fb99-4eb3-933c-3094a32df628 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.519424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a987610-fb99-4eb3-933c-3094a32df628 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.530979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 286/590] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:00.532054 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a987610-fb99-4eb3-933c-3094a32df628 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.577150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d8317-d284-473f-83e5-d5e4a546db73 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.609798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601beaea-7037-4ed7-ab4d-1ce9faab9d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.610816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601beaea-7037-4ed7-ab4d-1ce9faab9d45 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.611279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601beaea-7037-4ed7-ab4d-1ce9faab9d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.611694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601beaea-7037-4ed7-ab4d-1ce9faab9d45 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.618510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601beaea-7037-4ed7-ab4d-1ce9faab9d45 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.620104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601beaea-7037-4ed7-ab4d-1ce9faab9d45 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.626782 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a987610-fb99-4eb3-933c-3094a32df628 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-601beaea-7037-4ed7-ab4d-1ce9faab9d45 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:00.634285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:00.635387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:56:00.636510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:00.638364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 305/591] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:00.639238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601beaea-7037-4ed7-ab4d-1ce9faab9d45 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.659740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf25e-dcb8-4dc0-87f9-d6720ef6e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.660753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf25e-dcb8-4dc0-87f9-d6720ef6e874 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.661176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf25e-dcb8-4dc0-87f9-d6720ef6e874 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.661602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf25e-dcb8-4dc0-87f9-d6720ef6e874 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.669221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cf25e-dcb8-4dc0-87f9-d6720ef6e874 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.670695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cf25e-dcb8-4dc0-87f9-d6720ef6e874 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-844cf25e-dcb8-4dc0-87f9-d6720ef6e874 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:00.684370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:00.685308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 14:56:00.686728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:00.690215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 287/592] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:00.690819 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf25e-dcb8-4dc0-87f9-d6720ef6e874 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.739286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601beaea-7037-4ed7-ab4d-1ce9faab9d45 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.771547 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36b81b-08db-4ff0-99e3-6f7815c0cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.772545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36b81b-08db-4ff0-99e3-6f7815c0cb09 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.773119 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36b81b-08db-4ff0-99e3-6f7815c0cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.773390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36b81b-08db-4ff0-99e3-6f7815c0cb09 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.774252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36b81b-08db-4ff0-99e3-6f7815c0cb09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:00.774562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36b81b-08db-4ff0-99e3-6f7815c0cb09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.776046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36b81b-08db-4ff0-99e3-6f7815c0cb09 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.788412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 306/593] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:00.789249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36b81b-08db-4ff0-99e3-6f7815c0cb09 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.790175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf25e-dcb8-4dc0-87f9-d6720ef6e874 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.823662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405941-d38d-4e33-841c-e8f5b21e5aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.824561 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405941-d38d-4e33-841c-e8f5b21e5aa8 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.824820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405941-d38d-4e33-841c-e8f5b21e5aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.825086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405941-d38d-4e33-841c-e8f5b21e5aa8 None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/dc19a5d9ce774f39aa49ab7c64ba682e/roles/4235f90e4db94284adec59aa60035bf6` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.842428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405941-d38d-4e33-841c-e8f5b21e5aa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=dc19a5d9ce774f39aa49ab7c64ba682e, role_id=4235f90e4db94284adec59aa60035bf6)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.843886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405941-d38d-4e33-841c-e8f5b21e5aa8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.885144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36b81b-08db-4ff0-99e3-6f7815c0cb09 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:00.916872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d167585-c7e1-40ee-a7e8-a7b24f9829f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:00.917555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d167585-c7e1-40ee-a7e8-a7b24f9829f5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:00.917838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d167585-c7e1-40ee-a7e8-a7b24f9829f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:00.918141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d167585-c7e1-40ee-a7e8-a7b24f9829f5 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:00.918975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d167585-c7e1-40ee-a7e8-a7b24f9829f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:00.919285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d167585-c7e1-40ee-a7e8-a7b24f9829f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:00.926099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d167585-c7e1-40ee-a7e8-a7b24f9829f5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:00.926611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 288/594] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:00 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/dc19a5d9ce774f39aa49ab7c64ba682e/roles/4235f90e4db94284adec59aa60035bf6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:56:00.927852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405941-d38d-4e33-841c-e8f5b21e5aa8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:00.941142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 307/595] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:00.942003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d167585-c7e1-40ee-a7e8-a7b24f9829f5 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.062440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405941-d38d-4e33-841c-e8f5b21e5aa8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.077110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d167585-c7e1-40ee-a7e8-a7b24f9829f5 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.102462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0fff6-e0d9-4940-864e-08c2d72d98b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:01.103360 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0fff6-e0d9-4940-864e-08c2d72d98b2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:01.103743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0fff6-e0d9-4940-864e-08c2d72d98b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:01.104115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0fff6-e0d9-4940-864e-08c2d72d98b2 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:01.105066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0fff6-e0d9-4940-864e-08c2d72d98b2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:01.105476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0fff6-e0d9-4940-864e-08c2d72d98b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:01.107080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0fff6-e0d9-4940-864e-08c2d72d98b2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:01.129620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 289/596] 10.222.0.44 () {56 vars in 1139 bytes} [Mon May 16 14:56:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:01.131903 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0fff6-e0d9-4940-864e-08c2d72d98b2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.133392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897675f-bf3e-41df-9201-1e8036516ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:01.134548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897675f-bf3e-41df-9201-1e8036516ba7 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:01.134835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897675f-bf3e-41df-9201-1e8036516ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:01.135111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897675f-bf3e-41df-9201-1e8036516ba7 None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/d9237b353da546989b399ee9702d1bd8/roles/4235f90e4db94284adec59aa60035bf6` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:01.153295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897675f-bf3e-41df-9201-1e8036516ba7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=d9237b353da546989b399ee9702d1bd8, role_id=4235f90e4db94284adec59aa60035bf6)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:01.154774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897675f-bf3e-41df-9201-1e8036516ba7 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:01.231952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 308/597] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:00 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/d9237b353da546989b399ee9702d1bd8/roles/4235f90e4db94284adec59aa60035bf6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:56:01.232868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897675f-bf3e-41df-9201-1e8036516ba7 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.255165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0fff6-e0d9-4940-864e-08c2d72d98b2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.326549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae837-667d-4952-9341-56b7d48db2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:01.327278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae837-667d-4952-9341-56b7d48db2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:01.327560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae837-667d-4952-9341-56b7d48db2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:01.327835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae837-667d-4952-9341-56b7d48db2c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:01.349166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae837-667d-4952-9341-56b7d48db2c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:01.350677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae837-667d-4952-9341-56b7d48db2c5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-de8ae837-667d-4952-9341-56b7d48db2c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:01.372696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:01.373667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:01.374601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:01.374601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:01.374601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:01.374601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:01.379239 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 290/598] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:01.380576 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae837-667d-4952-9341-56b7d48db2c5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.417190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897675f-bf3e-41df-9201-1e8036516ba7 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.453322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf7311-e00b-4654-88fc-15634891938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:01.454157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf7311-e00b-4654-88fc-15634891938a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:01.454444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf7311-e00b-4654-88fc-15634891938a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:01.454748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf7311-e00b-4654-88fc-15634891938a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:01.466247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf7311-e00b-4654-88fc-15634891938a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:01.467736 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf7311-e00b-4654-88fc-15634891938a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-efaf7311-e00b-4654-88fc-15634891938a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:01.485780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:01.488417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:01.490559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:01.490559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:01.490559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:01.490559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:01.491075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae837-667d-4952-9341-56b7d48db2c5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.498106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 309/599] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:01.498527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf7311-e00b-4654-88fc-15634891938a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.528641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707136f-da4d-45dd-a281-d4bf9796229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:01.529320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707136f-da4d-45dd-a281-d4bf9796229a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:01.529604 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707136f-da4d-45dd-a281-d4bf9796229a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:01.529882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707136f-da4d-45dd-a281-d4bf9796229a None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:01.530645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707136f-da4d-45dd-a281-d4bf9796229a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:01.530953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707136f-da4d-45dd-a281-d4bf9796229a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:01.532350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707136f-da4d-45dd-a281-d4bf9796229a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:01.549592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 291/600] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:01.551000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707136f-da4d-45dd-a281-d4bf9796229a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.627774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf7311-e00b-4654-88fc-15634891938a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.652230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707136f-da4d-45dd-a281-d4bf9796229a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.662525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa80171-daa1-4fe2-87c2-c6e6439ee8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:01.663198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa80171-daa1-4fe2-87c2-c6e6439ee8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:01.663482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa80171-daa1-4fe2-87c2-c6e6439ee8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:01.663761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa80171-daa1-4fe2-87c2-c6e6439ee8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:01.664488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa80171-daa1-4fe2-87c2-c6e6439ee8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:01.664795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa80171-daa1-4fe2-87c2-c6e6439ee8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:01.666202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa80171-daa1-4fe2-87c2-c6e6439ee8f2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:01.678417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 310/601] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:01.684061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa80171-daa1-4fe2-87c2-c6e6439ee8f2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.686325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcced529-effc-49a9-9607-d2fde983e2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:01.687122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcced529-effc-49a9-9607-d2fde983e2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:01.687405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcced529-effc-49a9-9607-d2fde983e2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:01.687683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcced529-effc-49a9-9607-d2fde983e2b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:01.695645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcced529-effc-49a9-9607-d2fde983e2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:01.697135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcced529-effc-49a9-9607-d2fde983e2b7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-fcced529-effc-49a9-9607-d2fde983e2b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:01.711545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:01.713845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:01.716001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:01.716001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:01.716001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:01.716001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:01.716001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:01.716001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:01.716001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:01.716001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:01.717169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 292/602] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:01.724470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcced529-effc-49a9-9607-d2fde983e2b7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.788338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa80171-daa1-4fe2-87c2-c6e6439ee8f2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.822136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2e2fe-e310-4b88-b17e-200b396a18ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:01.822525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcced529-effc-49a9-9607-d2fde983e2b7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.822933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2e2fe-e310-4b88-b17e-200b396a18ef None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:01.823213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2e2fe-e310-4b88-b17e-200b396a18ef None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:01.823489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2e2fe-e310-4b88-b17e-200b396a18ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:01.830466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2e2fe-e310-4b88-b17e-200b396a18ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:01.831910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2e2fe-e310-4b88-b17e-200b396a18ef None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-bea2e2fe-e310-4b88-b17e-200b396a18ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:01.846964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:01.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:01.851101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:01.851101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:01.851101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:01.851101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:01.851101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:01.851101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:01.851101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:01.851101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:01.851101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 311/603] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:01.856962 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046b234-47c1-481f-bfb1-3d30e127ff8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:01.857632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046b234-47c1-481f-bfb1-3d30e127ff8f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:01.857922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046b234-47c1-481f-bfb1-3d30e127ff8f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:01.858228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046b234-47c1-481f-bfb1-3d30e127ff8f None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:01.858955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2e2fe-e310-4b88-b17e-200b396a18ef None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.859074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046b234-47c1-481f-bfb1-3d30e127ff8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:01.859311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046b234-47c1-481f-bfb1-3d30e127ff8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:01.860751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046b234-47c1-481f-bfb1-3d30e127ff8f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:01.878263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 293/604] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:01.879948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046b234-47c1-481f-bfb1-3d30e127ff8f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:01.979927 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046b234-47c1-481f-bfb1-3d30e127ff8f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:01.982006 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2e2fe-e310-4b88-b17e-200b396a18ef None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:02.019570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbca54b-21df-498f-b602-6201756bf8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:02.020336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca54b-21df-498f-b602-6201756bf8da None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:02.020708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca54b-21df-498f-b602-6201756bf8da None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:02.021061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca54b-21df-498f-b602-6201756bf8da None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/55591aa3b6324ce99d1529beb8f6de2b/roles/4235f90e4db94284adec59aa60035bf6` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:02.028919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c71414-83fd-4673-a555-8ca2ce5373e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:02.030266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71414-83fd-4673-a555-8ca2ce5373e5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:02.030571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71414-83fd-4673-a555-8ca2ce5373e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:02.030848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71414-83fd-4673-a555-8ca2ce5373e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:02.033466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c71414-83fd-4673-a555-8ca2ce5373e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:02.033466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c71414-83fd-4673-a555-8ca2ce5373e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:02.033983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c71414-83fd-4673-a555-8ca2ce5373e5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:02.042620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbca54b-21df-498f-b602-6201756bf8da None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=55591aa3b6324ce99d1529beb8f6de2b, role_id=4235f90e4db94284adec59aa60035bf6)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:02.043813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbca54b-21df-498f-b602-6201756bf8da None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:02.049324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 312/605] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:02.055086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c71414-83fd-4673-a555-8ca2ce5373e5 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:02.155920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c71414-83fd-4673-a555-8ca2ce5373e5 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:02.175415 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 294/606] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:01 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/55591aa3b6324ce99d1529beb8f6de2b/roles/4235f90e4db94284adec59aa60035bf6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:56:02.177387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2ddb2-ea6e-4bcf-8f1f-5a70eeddd413 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:02.177863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2ddb2-ea6e-4bcf-8f1f-5a70eeddd413 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:02.178312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2ddb2-ea6e-4bcf-8f1f-5a70eeddd413 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:02.180351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 295/607] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:02.192683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29295a5a-4479-4a4a-bd87-a9418d9fbc29 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:02.193084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29295a5a-4479-4a4a-bd87-a9418d9fbc29 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:02.193435 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29295a5a-4479-4a4a-bd87-a9418d9fbc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:02.222428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946923c-0478-4863-8f71-a1706c5a49f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:02.223343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946923c-0478-4863-8f71-a1706c5a49f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:02.223626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946923c-0478-4863-8f71-a1706c5a49f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:02.223903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946923c-0478-4863-8f71-a1706c5a49f9 None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/aec8440b7bd84c2b9ce583a01adabf90/roles/4235f90e4db94284adec59aa60035bf6` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:02.229520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-29295a5a-4479-4a4a-bd87-a9418d9fbc29 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:02.232524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-29295a5a-4479-4a4a-bd87-a9418d9fbc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:02.258719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946923c-0478-4863-8f71-a1706c5a49f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=aec8440b7bd84c2b9ce583a01adabf90, role_id=4235f90e4db94284adec59aa60035bf6)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:02.261823 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946923c-0478-4863-8f71-a1706c5a49f9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:02.330301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 296/608] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:02.352724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29295a5a-4479-4a4a-bd87-a9418d9fbc29 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:02.387746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 313/609] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:02 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/aec8440b7bd84c2b9ce583a01adabf90/roles/4235f90e4db94284adec59aa60035bf6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:56:02.471192 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29295a5a-4479-4a4a-bd87-a9418d9fbc29 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:02.508946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5936a65-f427-4661-924d-892872c12e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:02.510043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5936a65-f427-4661-924d-892872c12e70 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:02.510516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5936a65-f427-4661-924d-892872c12e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:02.510935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5936a65-f427-4661-924d-892872c12e70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:02.523594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5936a65-f427-4661-924d-892872c12e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c5936a65-f427-4661-924d-892872c12e70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:02.531745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:02.533513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:02.534597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:02.535473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 297/610] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:02.541723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946923c-0478-4863-8f71-a1706c5a49f9 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:02.695920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946923c-0478-4863-8f71-a1706c5a49f9 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:02.731768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d18f1-3430-4e4b-98b9-a1669e1f2c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:02.732371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d18f1-3430-4e4b-98b9-a1669e1f2c48 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:02.732656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d18f1-3430-4e4b-98b9-a1669e1f2c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:02.732935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d18f1-3430-4e4b-98b9-a1669e1f2c48 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:02.733688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d18f1-3430-4e4b-98b9-a1669e1f2c48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:02.733995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d18f1-3430-4e4b-98b9-a1669e1f2c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:02.735442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d18f1-3430-4e4b-98b9-a1669e1f2c48 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:02.744946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 314/611] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:56:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:02.751118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5936a65-f427-4661-924d-892872c12e70 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:02.888802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5936a65-f427-4661-924d-892872c12e70 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:02.932634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea4eb4-8f8e-4bda-87ec-6205159d5efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:02.933716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea4eb4-8f8e-4bda-87ec-6205159d5efa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:02.934186 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea4eb4-8f8e-4bda-87ec-6205159d5efa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:02.934622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea4eb4-8f8e-4bda-87ec-6205159d5efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:02.946614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea4eb4-8f8e-4bda-87ec-6205159d5efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:02.948288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea4eb4-8f8e-4bda-87ec-6205159d5efa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-78ea4eb4-8f8e-4bda-87ec-6205159d5efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:02.965769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:02.966879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:02.967978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:02.967978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:02.967978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:02.967978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:02.969850 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 298/612] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:02.979280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d18f1-3430-4e4b-98b9-a1669e1f2c48 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:03.098970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d18f1-3430-4e4b-98b9-a1669e1f2c48 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:03.137552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13f2ee-110b-4954-9928-133640aafc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:03.138405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13f2ee-110b-4954-9928-133640aafc86 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:03.138806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13f2ee-110b-4954-9928-133640aafc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:03.139179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13f2ee-110b-4954-9928-133640aafc86 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:03.140003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13f2ee-110b-4954-9928-133640aafc86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:03.140409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13f2ee-110b-4954-9928-133640aafc86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:03.141873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13f2ee-110b-4954-9928-133640aafc86 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:03.159652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 315/613] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:03.164975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea4eb4-8f8e-4bda-87ec-6205159d5efa None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:03.286282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea4eb4-8f8e-4bda-87ec-6205159d5efa None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:03.320969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f8cc1-0b2e-4adf-a73a-791aecd44e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:03.322040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f8cc1-0b2e-4adf-a73a-791aecd44e65 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:03.322494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f8cc1-0b2e-4adf-a73a-791aecd44e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:03.322938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f8cc1-0b2e-4adf-a73a-791aecd44e65 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:03.331097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f8cc1-0b2e-4adf-a73a-791aecd44e65 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:03.332726 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f8cc1-0b2e-4adf-a73a-791aecd44e65 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b77f8cc1-0b2e-4adf-a73a-791aecd44e65 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:03.348366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:03.349771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:03.350939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 299/614] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:03.355693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13f2ee-110b-4954-9928-133640aafc86 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:03.497987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13f2ee-110b-4954-9928-133640aafc86 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:03.552122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf7846-53ac-4cc7-a513-40212077f605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:03.552862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf7846-53ac-4cc7-a513-40212077f605 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:03.553171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf7846-53ac-4cc7-a513-40212077f605 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:03.553473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf7846-53ac-4cc7-a513-40212077f605 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:03.554383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf7846-53ac-4cc7-a513-40212077f605 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:03.554686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf7846-53ac-4cc7-a513-40212077f605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:03.556126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf7846-53ac-4cc7-a513-40212077f605 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:03.584005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 316/615] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 16 14:56:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:03.595246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f8cc1-0b2e-4adf-a73a-791aecd44e65 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:03.722099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f8cc1-0b2e-4adf-a73a-791aecd44e65 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:03.756853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0268c-71e2-405d-8a4f-57f93cec0d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:03.757662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0268c-71e2-405d-8a4f-57f93cec0d8d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:03.757948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0268c-71e2-405d-8a4f-57f93cec0d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:03.758251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0268c-71e2-405d-8a4f-57f93cec0d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:03.769346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0268c-71e2-405d-8a4f-57f93cec0d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:03.770827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0268c-71e2-405d-8a4f-57f93cec0d8d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9fc0268c-71e2-405d-8a4f-57f93cec0d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:03.788692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:03.790731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:03.792709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:03.792709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:03.792709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:03.792709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:03.792709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 300/616] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:03.795481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0268c-71e2-405d-8a4f-57f93cec0d8d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:03.795673 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768385b-d6ed-4134-be3f-b6f79a2ca1fa None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:03.796016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768385b-d6ed-4134-be3f-b6f79a2ca1fa None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:03.796241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768385b-d6ed-4134-be3f-b6f79a2ca1fa None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:03.797841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 317/617] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:03.803652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98c6b2-cc66-48b1-b15f-5e1cc89967b2 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:03.803935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98c6b2-cc66-48b1-b15f-5e1cc89967b2 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:03.804211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98c6b2-cc66-48b1-b15f-5e1cc89967b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:03.820868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-fb98c6b2-cc66-48b1-b15f-5e1cc89967b2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:03.822046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fb98c6b2-cc66-48b1-b15f-5e1cc89967b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:03.895386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 318/618] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:56:03.919095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98c6b2-cc66-48b1-b15f-5e1cc89967b2 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:03.966885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0268c-71e2-405d-8a4f-57f93cec0d8d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.005649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3757b85-a0e3-4b05-abcf-086006e13ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:04.006373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757b85-a0e3-4b05-abcf-086006e13ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.006659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757b85-a0e3-4b05-abcf-086006e13ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.006932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757b85-a0e3-4b05-abcf-086006e13ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.007659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3757b85-a0e3-4b05-abcf-086006e13ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:04.007968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3757b85-a0e3-4b05-abcf-086006e13ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:04.009337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3757b85-a0e3-4b05-abcf-086006e13ad6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:04.017851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98c6b2-cc66-48b1-b15f-5e1cc89967b2 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.022402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 301/619] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:04.027339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3757b85-a0e3-4b05-abcf-086006e13ad6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:04.052108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d7cea-fed5-47fd-91b7-345ace601212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:04.052955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7cea-fed5-47fd-91b7-345ace601212 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.053233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7cea-fed5-47fd-91b7-345ace601212 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.053504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d7cea-fed5-47fd-91b7-345ace601212 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.065733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d7cea-fed5-47fd-91b7-345ace601212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-623d7cea-fed5-47fd-91b7-345ace601212 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:04.075711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:04.076868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:04.077877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 319/620] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:04.083694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d7cea-fed5-47fd-91b7-345ace601212 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:04.164813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3757b85-a0e3-4b05-abcf-086006e13ad6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.186379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d7cea-fed5-47fd-91b7-345ace601212 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.199479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf047a8-0c67-401e-8b37-e0c1ae4b89d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:04.200271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf047a8-0c67-401e-8b37-e0c1ae4b89d3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.200553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf047a8-0c67-401e-8b37-e0c1ae4b89d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.200826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf047a8-0c67-401e-8b37-e0c1ae4b89d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.207834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf047a8-0c67-401e-8b37-e0c1ae4b89d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:04.209299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf047a8-0c67-401e-8b37-e0c1ae4b89d3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:04.219146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09373c2-0dce-414c-9f8a-196564732ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:04.219910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09373c2-0dce-414c-9f8a-196564732ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.220191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09373c2-0dce-414c-9f8a-196564732ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.221022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09373c2-0dce-414c-9f8a-196564732ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.221772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09373c2-0dce-414c-9f8a-196564732ff2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:04.222094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09373c2-0dce-414c-9f8a-196564732ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:04.223457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09373c2-0dce-414c-9f8a-196564732ff2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-edf047a8-0c67-401e-8b37-e0c1ae4b89d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:04.224118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:04.224987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:04.225882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:04.225882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:04.225882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:04.225882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:04.225882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:04.225882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:04.225882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:04.225882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:04.225882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 302/621] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:04.231295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab18e0-a9f4-4f67-9143-959f2b2d4b26 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.231295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab18e0-a9f4-4f67-9143-959f2b2d4b26 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.231295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab18e0-a9f4-4f67-9143-959f2b2d4b26 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.231873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 320/623] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:56:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:04.233168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 303/623] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:04.234702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141648f7-d800-4bca-b15a-aa2e979c62bf None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.234994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141648f7-d800-4bca-b15a-aa2e979c62bf None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.235273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141648f7-d800-4bca-b15a-aa2e979c62bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.237328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09373c2-0dce-414c-9f8a-196564732ff2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:04.252719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-141648f7-d800-4bca-b15a-aa2e979c62bf None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:04.253904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-141648f7-d800-4bca-b15a-aa2e979c62bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:04.325207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 304/624] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:56:04.326153 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141648f7-d800-4bca-b15a-aa2e979c62bf None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:04.335662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09373c2-0dce-414c-9f8a-196564732ff2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.377579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b806dd-f7c8-478d-bd8f-fbbc958f412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:04.378290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b806dd-f7c8-478d-bd8f-fbbc958f412e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.378576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b806dd-f7c8-478d-bd8f-fbbc958f412e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.379024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b806dd-f7c8-478d-bd8f-fbbc958f412e None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.380680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b806dd-f7c8-478d-bd8f-fbbc958f412e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:04.380996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b806dd-f7c8-478d-bd8f-fbbc958f412e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:04.382483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b806dd-f7c8-478d-bd8f-fbbc958f412e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:04.398274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 321/625] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:04.399200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b806dd-f7c8-478d-bd8f-fbbc958f412e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:04.455771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141648f7-d800-4bca-b15a-aa2e979c62bf None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.499363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960774a-928a-47dc-9809-2c14e7e491e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:04.500678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960774a-928a-47dc-9809-2c14e7e491e4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.501082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960774a-928a-47dc-9809-2c14e7e491e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.501364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960774a-928a-47dc-9809-2c14e7e491e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.513991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960774a-928a-47dc-9809-2c14e7e491e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:04.515977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960774a-928a-47dc-9809-2c14e7e491e4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:04.520451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b806dd-f7c8-478d-bd8f-fbbc958f412e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-1960774a-928a-47dc-9809-2c14e7e491e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:04.538899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:04.540869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:04.542760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:04.542760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:04.542760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:04.542760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:04.550080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 305/626] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:04.550080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960774a-928a-47dc-9809-2c14e7e491e4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:04.565749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204198bd-3231-435c-886a-e9cf788cacf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:04.566885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204198bd-3231-435c-886a-e9cf788cacf7 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.567172 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204198bd-3231-435c-886a-e9cf788cacf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.567447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204198bd-3231-435c-886a-e9cf788cacf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.581469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204198bd-3231-435c-886a-e9cf788cacf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-204198bd-3231-435c-886a-e9cf788cacf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:04.591060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:04.592230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:04.593382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 322/627] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:04.594661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204198bd-3231-435c-886a-e9cf788cacf7 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:04.656724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960774a-928a-47dc-9809-2c14e7e491e4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.692206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb326e4-d350-4e85-8493-c772b893634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:04.693197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb326e4-d350-4e85-8493-c772b893634d None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.693573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb326e4-d350-4e85-8493-c772b893634d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.693929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb326e4-d350-4e85-8493-c772b893634d None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/6a6668cb0bda4d61b6b96f547a422830/roles/4235f90e4db94284adec59aa60035bf6` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.708488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb326e4-d350-4e85-8493-c772b893634d None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=6a6668cb0bda4d61b6b96f547a422830, role_id=4235f90e4db94284adec59aa60035bf6)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:04.709948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb326e4-d350-4e85-8493-c772b893634d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:04.715335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204198bd-3231-435c-886a-e9cf788cacf7 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.748136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47a38f-347e-45f8-87e3-15e4e2a63c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:04.748802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47a38f-347e-45f8-87e3-15e4e2a63c9b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:04.749080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47a38f-347e-45f8-87e3-15e4e2a63c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:04.749349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47a38f-347e-45f8-87e3-15e4e2a63c9b None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:04.750120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47a38f-347e-45f8-87e3-15e4e2a63c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:04.750425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47a38f-347e-45f8-87e3-15e4e2a63c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:04.751814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47a38f-347e-45f8-87e3-15e4e2a63c9b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:04.767799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 323/628] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:04.767799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47a38f-347e-45f8-87e3-15e4e2a63c9b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:04.796063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 306/629] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:04 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/6a6668cb0bda4d61b6b96f547a422830/roles/4235f90e4db94284adec59aa60035bf6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:56:04.796063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb326e4-d350-4e85-8493-c772b893634d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:04.959944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47a38f-347e-45f8-87e3-15e4e2a63c9b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:04.965148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb326e4-d350-4e85-8493-c772b893634d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:05.021808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a1870-296c-4228-9344-d5e3a0806978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.022631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a1870-296c-4228-9344-d5e3a0806978 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.022916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a1870-296c-4228-9344-d5e3a0806978 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.023189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a1870-296c-4228-9344-d5e3a0806978 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.027735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56c6c8-3eea-48cc-be38-46e717effaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.028410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56c6c8-3eea-48cc-be38-46e717effaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.028691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56c6c8-3eea-48cc-be38-46e717effaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.029043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56c6c8-3eea-48cc-be38-46e717effaa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.029809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56c6c8-3eea-48cc-be38-46e717effaa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:05.031061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56c6c8-3eea-48cc-be38-46e717effaa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:05.033639 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a1870-296c-4228-9344-d5e3a0806978 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:05.033903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56c6c8-3eea-48cc-be38-46e717effaa0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:05.035123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a1870-296c-4228-9344-d5e3a0806978 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:05.047285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 324/630] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:56:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:05.054895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56c6c8-3eea-48cc-be38-46e717effaa0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0b7a1870-296c-4228-9344-d5e3a0806978 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:05.055772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:05.056699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:05.057650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 307/631] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 16 14:56:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:05.067090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a1870-296c-4228-9344-d5e3a0806978 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.179708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56c6c8-3eea-48cc-be38-46e717effaa0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:05.182180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a1870-296c-4228-9344-d5e3a0806978 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:05.213995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dae1a5-211b-4aac-bca9-5f6014624c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.214739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dae1a5-211b-4aac-bca9-5f6014624c29 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.215018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dae1a5-211b-4aac-bca9-5f6014624c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.215289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dae1a5-211b-4aac-bca9-5f6014624c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.216681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3a00e-0441-463a-8e44-8fc3e6a31a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.217350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3a00e-0441-463a-8e44-8fc3e6a31a99 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.217891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3a00e-0441-463a-8e44-8fc3e6a31a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.217891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3a00e-0441-463a-8e44-8fc3e6a31a99 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.218742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3a00e-0441-463a-8e44-8fc3e6a31a99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:05.219055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3a00e-0441-463a-8e44-8fc3e6a31a99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:05.221093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3a00e-0441-463a-8e44-8fc3e6a31a99 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:05.226202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dae1a5-211b-4aac-bca9-5f6014624c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:05.227644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dae1a5-211b-4aac-bca9-5f6014624c29 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:05.238646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 308/632] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:05.239939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cacac-3dd9-427a-a433-4726907fa03b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.240220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cacac-3dd9-427a-a433-4726907fa03b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.240491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cacac-3dd9-427a-a433-4726907fa03b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-d8dae1a5-211b-4aac-bca9-5f6014624c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:05.245456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:05.246688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:05.247768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:05.247768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:05.247768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:05.247768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:05.248053 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 309/633] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:05.248053 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe7b81-eff9-474d-9e2e-c326ad548e95 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.248053 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe7b81-eff9-474d-9e2e-c326ad548e95 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.248053 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe7b81-eff9-474d-9e2e-c326ad548e95 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.248697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 310/634] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:05.249383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe7b81-eff9-474d-9e2e-c326ad548e95 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.250440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 325/635] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:05.251925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a53b-1458-43e5-900b-b932553a8f38 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.252342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a53b-1458-43e5-900b-b932553a8f38 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.252746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a53b-1458-43e5-900b-b932553a8f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.274456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-31a3a53b-1458-43e5-900b-b932553a8f38 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:05.275629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-31a3a53b-1458-43e5-900b-b932553a8f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:05.346499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 326/636] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:05.352969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe7b81-eff9-474d-9e2e-c326ad548e95 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:05.359536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5714d-9ecf-4f9c-b8ca-b3a9db131819 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.360454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5714d-9ecf-4f9c-b8ca-b3a9db131819 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.361418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5714d-9ecf-4f9c-b8ca-b3a9db131819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.380248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-27a5714d-9ecf-4f9c-b8ca-b3a9db131819 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:05.381410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-27a5714d-9ecf-4f9c-b8ca-b3a9db131819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:05.387414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edc69-bddc-473a-9399-7d2c54a309ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.388070 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edc69-bddc-473a-9399-7d2c54a309ea None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.388401 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edc69-bddc-473a-9399-7d2c54a309ea None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.388682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edc69-bddc-473a-9399-7d2c54a309ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.448420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 327/637] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:05.449382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5714d-9ecf-4f9c-b8ca-b3a9db131819 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.464297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edc69-bddc-473a-9399-7d2c54a309ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:05.465699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edc69-bddc-473a-9399-7d2c54a309ea None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:05.545475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5714d-9ecf-4f9c-b8ca-b3a9db131819 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:05.571357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 311/638] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:56:05.572454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edc69-bddc-473a-9399-7d2c54a309ea None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.584554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d071d94-b4fc-4bd1-a8ba-512083de5c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.585468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d071d94-b4fc-4bd1-a8ba-512083de5c53 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.585929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d071d94-b4fc-4bd1-a8ba-512083de5c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.586405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d071d94-b4fc-4bd1-a8ba-512083de5c53 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.587552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d071d94-b4fc-4bd1-a8ba-512083de5c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:05.588056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d071d94-b4fc-4bd1-a8ba-512083de5c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:05.589613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d071d94-b4fc-4bd1-a8ba-512083de5c53 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:05.605094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 328/639] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:05.606218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d071d94-b4fc-4bd1-a8ba-512083de5c53 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.667811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edc69-bddc-473a-9399-7d2c54a309ea None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:05.700573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d202f-8003-45b2-83b9-9d662b8069ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.701369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d202f-8003-45b2-83b9-9d662b8069ee None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.701652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d202f-8003-45b2-83b9-9d662b8069ee None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.701928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d202f-8003-45b2-83b9-9d662b8069ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.704225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d071d94-b4fc-4bd1-a8ba-512083de5c53 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:05.712157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d202f-8003-45b2-83b9-9d662b8069ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b21d202f-8003-45b2-83b9-9d662b8069ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:05.719857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:05.721591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 312/640] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:05.722653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d202f-8003-45b2-83b9-9d662b8069ee None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.744097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1129f2-cfb6-47e7-ab7e-7e808ccb5fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.745170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1129f2-cfb6-47e7-ab7e-7e808ccb5fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.745644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1129f2-cfb6-47e7-ab7e-7e808ccb5fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.746159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1129f2-cfb6-47e7-ab7e-7e808ccb5fd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.756320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1129f2-cfb6-47e7-ab7e-7e808ccb5fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-6c1129f2-cfb6-47e7-ab7e-7e808ccb5fd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:05.764116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:05.765224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:05.766270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:05.768676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 329/641] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:05.769715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1129f2-cfb6-47e7-ab7e-7e808ccb5fd6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.818509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d202f-8003-45b2-83b9-9d662b8069ee None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:05.851470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9275-c678-4449-bce7-105a6a1ae22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.852257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9275-c678-4449-bce7-105a6a1ae22b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.852539 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9275-c678-4449-bce7-105a6a1ae22b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.852814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb9275-c678-4449-bce7-105a6a1ae22b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.864469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb9275-c678-4449-bce7-105a6a1ae22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:05.865932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb9275-c678-4449-bce7-105a6a1ae22b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:05.869212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1129f2-cfb6-47e7-ab7e-7e808ccb5fd6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-caeb9275-c678-4449-bce7-105a6a1ae22b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:05.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:05.883915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:05.884895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:05.884895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:05.884895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:05.884895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:05.884895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 313/642] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:05.884895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9275-c678-4449-bce7-105a6a1ae22b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.905002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341331-d0f7-4d06-9d5f-df8f59e7db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:05.905786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341331-d0f7-4d06-9d5f-df8f59e7db55 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:05.906082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341331-d0f7-4d06-9d5f-df8f59e7db55 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:05.906376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341331-d0f7-4d06-9d5f-df8f59e7db55 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:05.913536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4341331-d0f7-4d06-9d5f-df8f59e7db55 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:05.915008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4341331-d0f7-4d06-9d5f-df8f59e7db55 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c4341331-d0f7-4d06-9d5f-df8f59e7db55 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:05.929159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:05.935026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 330/643] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:05.936124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341331-d0f7-4d06-9d5f-df8f59e7db55 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:05.984456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb9275-c678-4449-bce7-105a6a1ae22b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.022435 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da6f65-7dcd-41f0-b35a-e3cfcefc96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.023132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da6f65-7dcd-41f0-b35a-e3cfcefc96e7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.023419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da6f65-7dcd-41f0-b35a-e3cfcefc96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.023696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da6f65-7dcd-41f0-b35a-e3cfcefc96e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.024463 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da6f65-7dcd-41f0-b35a-e3cfcefc96e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:06.024773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da6f65-7dcd-41f0-b35a-e3cfcefc96e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.026202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da6f65-7dcd-41f0-b35a-e3cfcefc96e7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.031168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341331-d0f7-4d06-9d5f-df8f59e7db55 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.039757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 314/644] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:06.039757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da6f65-7dcd-41f0-b35a-e3cfcefc96e7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.065683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1149-cc92-45bf-bc16-d5f1738b43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.066377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1149-cc92-45bf-bc16-d5f1738b43ee None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.066655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1149-cc92-45bf-bc16-d5f1738b43ee None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.066923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1149-cc92-45bf-bc16-d5f1738b43ee None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.067659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1149-cc92-45bf-bc16-d5f1738b43ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:06.067958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1149-cc92-45bf-bc16-d5f1738b43ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.069487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1149-cc92-45bf-bc16-d5f1738b43ee None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.082421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 331/645] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:56:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:06.083180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1149-cc92-45bf-bc16-d5f1738b43ee None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.139501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da6f65-7dcd-41f0-b35a-e3cfcefc96e7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.172389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe323d5-283f-402f-9df8-9105c9fadea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.173069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe323d5-283f-402f-9df8-9105c9fadea3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.173347 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe323d5-283f-402f-9df8-9105c9fadea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.173636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe323d5-283f-402f-9df8-9105c9fadea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.174381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe323d5-283f-402f-9df8-9105c9fadea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:06.174680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe323d5-283f-402f-9df8-9105c9fadea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.176044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe323d5-283f-402f-9df8-9105c9fadea3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.180682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1149-cc92-45bf-bc16-d5f1738b43ee None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.192406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 315/646] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:06.192406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe323d5-283f-402f-9df8-9105c9fadea3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.218759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012da60-240e-4b58-9d0e-09015ed4a213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.219437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012da60-240e-4b58-9d0e-09015ed4a213 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.219704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012da60-240e-4b58-9d0e-09015ed4a213 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.219974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012da60-240e-4b58-9d0e-09015ed4a213 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.220816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012da60-240e-4b58-9d0e-09015ed4a213 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:06.221116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012da60-240e-4b58-9d0e-09015ed4a213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.222566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012da60-240e-4b58-9d0e-09015ed4a213 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.238639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 332/647] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:06.239372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012da60-240e-4b58-9d0e-09015ed4a213 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.288414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe323d5-283f-402f-9df8-9105c9fadea3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.320706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74f637-616f-489f-b846-9030b51bbabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.321494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74f637-616f-489f-b846-9030b51bbabd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.321778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74f637-616f-489f-b846-9030b51bbabd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.322074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74f637-616f-489f-b846-9030b51bbabd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.332508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74f637-616f-489f-b846-9030b51bbabd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.333946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74f637-616f-489f-b846-9030b51bbabd None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.335911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012da60-240e-4b58-9d0e-09015ed4a213 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ca74f637-616f-489f-b846-9030b51bbabd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:06.351830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:06.352737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:06.353677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:06.353677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:06.353677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:06.353677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:06.353677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 316/648] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:06.353968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74f637-616f-489f-b846-9030b51bbabd None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.375019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e2bc1-1d7c-4be9-82e9-11290f71e047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.375796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e2bc1-1d7c-4be9-82e9-11290f71e047 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.376075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e2bc1-1d7c-4be9-82e9-11290f71e047 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.376343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e2bc1-1d7c-4be9-82e9-11290f71e047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.385903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e2bc1-1d7c-4be9-82e9-11290f71e047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.387504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e2bc1-1d7c-4be9-82e9-11290f71e047 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-e23e2bc1-1d7c-4be9-82e9-11290f71e047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:06.404010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:06.405158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:06.406293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:06.406293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:06.406293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:06.406293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:06.406293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 333/649] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:06.406293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e2bc1-1d7c-4be9-82e9-11290f71e047 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.460526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74f637-616f-489f-b846-9030b51bbabd None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.494456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882deee5-5aee-4cb3-90a3-b2f6fd9d0bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.495468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882deee5-5aee-4cb3-90a3-b2f6fd9d0bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.495744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882deee5-5aee-4cb3-90a3-b2f6fd9d0bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.496014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882deee5-5aee-4cb3-90a3-b2f6fd9d0bd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.502081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e2bc1-1d7c-4be9-82e9-11290f71e047 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.503047 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882deee5-5aee-4cb3-90a3-b2f6fd9d0bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.504511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882deee5-5aee-4cb3-90a3-b2f6fd9d0bd9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-882deee5-5aee-4cb3-90a3-b2f6fd9d0bd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:06.518290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:06.519384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:06.520309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:06.520309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:06.520309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:06.520309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:06.520309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:06.520309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:06.520309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:06.520309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:06.520309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 317/650] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:06.520806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882deee5-5aee-4cb3-90a3-b2f6fd9d0bd9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.542190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bad693-72fe-4288-86c5-94fe244c89f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.542982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bad693-72fe-4288-86c5-94fe244c89f2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.543365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bad693-72fe-4288-86c5-94fe244c89f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.543646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bad693-72fe-4288-86c5-94fe244c89f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.611109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bad693-72fe-4288-86c5-94fe244c89f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.612555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bad693-72fe-4288-86c5-94fe244c89f2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.622989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882deee5-5aee-4cb3-90a3-b2f6fd9d0bd9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.655853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ecadf-bb40-452c-ade7-bbc1dfa53a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.656515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ecadf-bb40-452c-ade7-bbc1dfa53a8e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.656813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ecadf-bb40-452c-ade7-bbc1dfa53a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.657066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ecadf-bb40-452c-ade7-bbc1dfa53a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.657879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ecadf-bb40-452c-ade7-bbc1dfa53a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:06.658711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ecadf-bb40-452c-ade7-bbc1dfa53a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.660095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ecadf-bb40-452c-ade7-bbc1dfa53a8e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.671495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 318/651] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:06.677052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ecadf-bb40-452c-ade7-bbc1dfa53a8e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.712951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 334/652] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:56:06.712951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bad693-72fe-4288-86c5-94fe244c89f2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.769886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ecadf-bb40-452c-ade7-bbc1dfa53a8e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.803283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604b95f-7ed2-4e68-9b63-52bde5a199a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.803948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604b95f-7ed2-4e68-9b63-52bde5a199a3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.804230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604b95f-7ed2-4e68-9b63-52bde5a199a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.804505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604b95f-7ed2-4e68-9b63-52bde5a199a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.804940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bad693-72fe-4288-86c5-94fe244c89f2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.805221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604b95f-7ed2-4e68-9b63-52bde5a199a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:06.805528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604b95f-7ed2-4e68-9b63-52bde5a199a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.806921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604b95f-7ed2-4e68-9b63-52bde5a199a3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.818706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 319/653] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:06.819727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604b95f-7ed2-4e68-9b63-52bde5a199a3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.838636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6d5c-e931-4baa-89b0-ce232266425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.839295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6d5c-e931-4baa-89b0-ce232266425f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.839576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6d5c-e931-4baa-89b0-ce232266425f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.839848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6d5c-e931-4baa-89b0-ce232266425f None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.840632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a6d5c-e931-4baa-89b0-ce232266425f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:06.840941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a6d5c-e931-4baa-89b0-ce232266425f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.842412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a6d5c-e931-4baa-89b0-ce232266425f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.853701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 335/654] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:06.854812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6d5c-e931-4baa-89b0-ce232266425f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.918010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604b95f-7ed2-4e68-9b63-52bde5a199a3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.951465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6d5c-e931-4baa-89b0-ce232266425f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:06.953382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27f2b8-0660-4bae-b51e-5834885d64c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.954339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27f2b8-0660-4bae-b51e-5834885d64c4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.955263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27f2b8-0660-4bae-b51e-5834885d64c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.955575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27f2b8-0660-4bae-b51e-5834885d64c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:06.964243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27f2b8-0660-4bae-b51e-5834885d64c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:06.965836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27f2b8-0660-4bae-b51e-5834885d64c4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-1f27f2b8-0660-4bae-b51e-5834885d64c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:06.980537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:06.981734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:56:06.982900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:06.988108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 320/655] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:06.988743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27f2b8-0660-4bae-b51e-5834885d64c4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:06.989037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5cd4-2848-4f4a-8f1a-a5c2d773d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:06.989832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5cd4-2848-4f4a-8f1a-a5c2d773d0fc None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:06.990145 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5cd4-2848-4f4a-8f1a-a5c2d773d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:06.990423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5cd4-2848-4f4a-8f1a-a5c2d773d0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.001187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e5cd4-2848-4f4a-8f1a-a5c2d773d0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:07.003227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e5cd4-2848-4f4a-8f1a-a5c2d773d0fc None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-a86e5cd4-2848-4f4a-8f1a-a5c2d773d0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:07.020738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:07.021803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:07.022755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:07.022755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:07.022755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:07.022755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:07.022755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 336/656] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:07.023199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5cd4-2848-4f4a-8f1a-a5c2d773d0fc None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.098421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27f2b8-0660-4bae-b51e-5834885d64c4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:07.117501 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5cd4-2848-4f4a-8f1a-a5c2d773d0fc None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:07.131189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280649f2-914a-4fbf-ac2d-7b42d08794a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:07.132066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280649f2-914a-4fbf-ac2d-7b42d08794a6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.132343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280649f2-914a-4fbf-ac2d-7b42d08794a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.132611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280649f2-914a-4fbf-ac2d-7b42d08794a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.139862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280649f2-914a-4fbf-ac2d-7b42d08794a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:07.141238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280649f2-914a-4fbf-ac2d-7b42d08794a6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:07.150289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758afb-27f8-476a-9c81-3d988f806dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:07.150940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758afb-27f8-476a-9c81-3d988f806dac None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.151220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758afb-27f8-476a-9c81-3d988f806dac None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.151494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758afb-27f8-476a-9c81-3d988f806dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.152318 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb758afb-27f8-476a-9c81-3d988f806dac None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=dc19a5d9ce774f39aa49ab7c64ba682e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:07.152631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb758afb-27f8-476a-9c81-3d988f806dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:07.154032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb758afb-27f8-476a-9c81-3d988f806dac None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-280649f2-914a-4fbf-ac2d-7b42d08794a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:07.155193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:07.156343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:07.157297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 321/657] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:07.158138 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280649f2-914a-4fbf-ac2d-7b42d08794a6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.165089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 337/658] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/role_assignments?user.id=dc19a5d9ce774f39aa49ab7c64ba682e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:07.165089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758afb-27f8-476a-9c81-3d988f806dac None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.261949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280649f2-914a-4fbf-ac2d-7b42d08794a6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:07.268180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758afb-27f8-476a-9c81-3d988f806dac None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:07.296236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504ca7f-9cf8-4243-89a3-38361482caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:07.297023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504ca7f-9cf8-4243-89a3-38361482caa1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.297381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504ca7f-9cf8-4243-89a3-38361482caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.297655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504ca7f-9cf8-4243-89a3-38361482caa1 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.299035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504ca7f-9cf8-4243-89a3-38361482caa1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:07.299347 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504ca7f-9cf8-4243-89a3-38361482caa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:07.300914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504ca7f-9cf8-4243-89a3-38361482caa1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:07.302388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f318a2-f510-49f4-9f7d-5000a9b87548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:07.303069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f318a2-f510-49f4-9f7d-5000a9b87548 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.303354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f318a2-f510-49f4-9f7d-5000a9b87548 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.303621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f318a2-f510-49f4-9f7d-5000a9b87548 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.304366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f318a2-f510-49f4-9f7d-5000a9b87548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:07.304674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f318a2-f510-49f4-9f7d-5000a9b87548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:07.306155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f318a2-f510-49f4-9f7d-5000a9b87548 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:07.327763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 338/659] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:07.327763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8d78e-225d-41f7-9350-03e8b7977d1d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.327763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8d78e-225d-41f7-9350-03e8b7977d1d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.327763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8d78e-225d-41f7-9350-03e8b7977d1d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.328169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 322/660] 10.222.0.44 () {56 vars in 1137 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:07.328169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504ca7f-9cf8-4243-89a3-38361482caa1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.328388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 339/661] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:07.328388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8d78e-225d-41f7-9350-03e8b7977d1d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.431383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504ca7f-9cf8-4243-89a3-38361482caa1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:07.441035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8d78e-225d-41f7-9350-03e8b7977d1d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:07.465732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed94fa3-50b3-4cc8-bfc0-86191510aa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:07.466524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94fa3-50b3-4cc8-bfc0-86191510aa5c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.466881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94fa3-50b3-4cc8-bfc0-86191510aa5c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.467154 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed94fa3-50b3-4cc8-bfc0-86191510aa5c None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.467979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94fa3-50b3-4cc8-bfc0-86191510aa5c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:07.468281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94fa3-50b3-4cc8-bfc0-86191510aa5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:07.469720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed94fa3-50b3-4cc8-bfc0-86191510aa5c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:07.473869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace3921-2574-4b5b-910f-8bb9e51aeae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:07.474619 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace3921-2574-4b5b-910f-8bb9e51aeae6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.474970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace3921-2574-4b5b-910f-8bb9e51aeae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.475308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace3921-2574-4b5b-910f-8bb9e51aeae6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.491348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 323/662] 10.222.0.44 () {56 vars in 1139 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:07.491348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba360-2fd4-44ea-bdb4-11394daeedb7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.491348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba360-2fd4-44ea-bdb4-11394daeedb7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.491348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba360-2fd4-44ea-bdb4-11394daeedb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.507027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1dbba360-2fd4-44ea-bdb4-11394daeedb7 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:07.508282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1dbba360-2fd4-44ea-bdb4-11394daeedb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:07.543622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace3921-2574-4b5b-910f-8bb9e51aeae6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:07.545067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace3921-2574-4b5b-910f-8bb9e51aeae6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:07.586326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 324/663] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:07.587338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbba360-2fd4-44ea-bdb4-11394daeedb7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.653058 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 340/664] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 14:56:07.653991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace3921-2574-4b5b-910f-8bb9e51aeae6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.683474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbba360-2fd4-44ea-bdb4-11394daeedb7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:07.715814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2a21b-fd1d-48d9-a47d-2c0f646061aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:07.716598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2a21b-fd1d-48d9-a47d-2c0f646061aa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.716873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2a21b-fd1d-48d9-a47d-2c0f646061aa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.717141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2a21b-fd1d-48d9-a47d-2c0f646061aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.724148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2a21b-fd1d-48d9-a47d-2c0f646061aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:07.725576 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2a21b-fd1d-48d9-a47d-2c0f646061aa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-95f2a21b-fd1d-48d9-a47d-2c0f646061aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:07.739932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:07.740896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 325/665] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:07.742423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2a21b-fd1d-48d9-a47d-2c0f646061aa None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.753302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace3921-2574-4b5b-910f-8bb9e51aeae6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:07.787065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f770f-e455-4c1a-8edc-6746aec81392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:07.787704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f770f-e455-4c1a-8edc-6746aec81392 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.787979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f770f-e455-4c1a-8edc-6746aec81392 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.788245 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f770f-e455-4c1a-8edc-6746aec81392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.838588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2a21b-fd1d-48d9-a47d-2c0f646061aa None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:07.852012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f770f-e455-4c1a-8edc-6746aec81392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:07.853454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f770f-e455-4c1a-8edc-6746aec81392 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:07.872962 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991396f2-4258-420b-99fa-55d275ee7825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:07.873752 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991396f2-4258-420b-99fa-55d275ee7825 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:07.874035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991396f2-4258-420b-99fa-55d275ee7825 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:07.874341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991396f2-4258-420b-99fa-55d275ee7825 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:07.884663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991396f2-4258-420b-99fa-55d275ee7825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-991396f2-4258-420b-99fa-55d275ee7825 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:07.892417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:07.893380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 326/666] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:07.898945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991396f2-4258-420b-99fa-55d275ee7825 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.948234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 341/667] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:56:07.949386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f770f-e455-4c1a-8edc-6746aec81392 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:07.999311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991396f2-4258-420b-99fa-55d275ee7825 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.032365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564d8ab-a320-4ca7-a3f1-35f76a934311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.033668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564d8ab-a320-4ca7-a3f1-35f76a934311 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.033944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564d8ab-a320-4ca7-a3f1-35f76a934311 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.034244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564d8ab-a320-4ca7-a3f1-35f76a934311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.045260 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564d8ab-a320-4ca7-a3f1-35f76a934311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.046730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564d8ab-a320-4ca7-a3f1-35f76a934311 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.052115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f770f-e455-4c1a-8edc-6746aec81392 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0564d8ab-a320-4ca7-a3f1-35f76a934311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:08.063800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:08.064776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:08.065779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:08.065779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:08.065779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:08.065779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:08.069611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 327/668] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:08.070307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564d8ab-a320-4ca7-a3f1-35f76a934311 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.085783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf23597-9dce-4c2f-b3c7-acd7f4209a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.086510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf23597-9dce-4c2f-b3c7-acd7f4209a3e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.086794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf23597-9dce-4c2f-b3c7-acd7f4209a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.087333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf23597-9dce-4c2f-b3c7-acd7f4209a3e None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.088116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf23597-9dce-4c2f-b3c7-acd7f4209a3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:08.088422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf23597-9dce-4c2f-b3c7-acd7f4209a3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.089902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf23597-9dce-4c2f-b3c7-acd7f4209a3e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.101554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 342/669] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:08.102179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf23597-9dce-4c2f-b3c7-acd7f4209a3e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.178660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564d8ab-a320-4ca7-a3f1-35f76a934311 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.197451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf23597-9dce-4c2f-b3c7-acd7f4209a3e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.211366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a7e78-5974-4acb-ab05-e8cdb15f8963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.212288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a7e78-5974-4acb-ab05-e8cdb15f8963 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.212569 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a7e78-5974-4acb-ab05-e8cdb15f8963 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.212842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a7e78-5974-4acb-ab05-e8cdb15f8963 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.213582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a7e78-5974-4acb-ab05-e8cdb15f8963 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:08.213885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a7e78-5974-4acb-ab05-e8cdb15f8963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.215304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a7e78-5974-4acb-ab05-e8cdb15f8963 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.223938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 328/670] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:08.224903 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a7e78-5974-4acb-ab05-e8cdb15f8963 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.235721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdcb72-e7a0-42bc-9d49-e6916321051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.237201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdcb72-e7a0-42bc-9d49-e6916321051f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.237741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdcb72-e7a0-42bc-9d49-e6916321051f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.238200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdcb72-e7a0-42bc-9d49-e6916321051f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.252412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdcb72-e7a0-42bc-9d49-e6916321051f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.254867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdcb72-e7a0-42bc-9d49-e6916321051f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-41cdcb72-e7a0-42bc-9d49-e6916321051f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:08.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:08.277496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:08.278620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:08.278620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:08.278620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:08.278620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:08.284983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 343/671] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:08.286214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdcb72-e7a0-42bc-9d49-e6916321051f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.321101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a7e78-5974-4acb-ab05-e8cdb15f8963 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.355738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249578-2ddf-4728-813b-c90daa3c0b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.356349 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249578-2ddf-4728-813b-c90daa3c0b1d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.356629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249578-2ddf-4728-813b-c90daa3c0b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.356898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0249578-2ddf-4728-813b-c90daa3c0b1d None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.357679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0249578-2ddf-4728-813b-c90daa3c0b1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:08.357908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0249578-2ddf-4728-813b-c90daa3c0b1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.359311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0249578-2ddf-4728-813b-c90daa3c0b1d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.371709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 329/672] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:08.372283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249578-2ddf-4728-813b-c90daa3c0b1d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.392726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdcb72-e7a0-42bc-9d49-e6916321051f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.424767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9270-aa74-4a90-9f8c-00920a8df889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.425423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9270-aa74-4a90-9f8c-00920a8df889 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.425703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9270-aa74-4a90-9f8c-00920a8df889 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.425973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9270-aa74-4a90-9f8c-00920a8df889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.426828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9270-aa74-4a90-9f8c-00920a8df889 None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=d9237b353da546989b399ee9702d1bd8) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:08.427137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9270-aa74-4a90-9f8c-00920a8df889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.428554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9270-aa74-4a90-9f8c-00920a8df889 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.438192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 344/673] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/role_assignments?user.id=d9237b353da546989b399ee9702d1bd8&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:08.438192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9270-aa74-4a90-9f8c-00920a8df889 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.489446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0249578-2ddf-4728-813b-c90daa3c0b1d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.525702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd2f9e-168c-4393-a6c7-f83fbcfcefb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.527585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd2f9e-168c-4393-a6c7-f83fbcfcefb0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.527945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd2f9e-168c-4393-a6c7-f83fbcfcefb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.528295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd2f9e-168c-4393-a6c7-f83fbcfcefb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.542391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd2f9e-168c-4393-a6c7-f83fbcfcefb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.545090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd2f9e-168c-4393-a6c7-f83fbcfcefb0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.566030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9270-aa74-4a90-9f8c-00920a8df889 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b1bd2f9e-168c-4393-a6c7-f83fbcfcefb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:08.567548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:08.568406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:08.569321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:08.569321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:08.569321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:08.569321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:08.573900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 330/674] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:08.574978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd2f9e-168c-4393-a6c7-f83fbcfcefb0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.614171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18834b-2668-43f1-add9-df0949eda675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.615138 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18834b-2668-43f1-add9-df0949eda675 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.615600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18834b-2668-43f1-add9-df0949eda675 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.616055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18834b-2668-43f1-add9-df0949eda675 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.616965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18834b-2668-43f1-add9-df0949eda675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:08.617468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18834b-2668-43f1-add9-df0949eda675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.619018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18834b-2668-43f1-add9-df0949eda675 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.631487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 345/675] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:08.633338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18834b-2668-43f1-add9-df0949eda675 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.678894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd2f9e-168c-4393-a6c7-f83fbcfcefb0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.713276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51eb22-1e35-49ac-8d77-f5163c820281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.714153 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51eb22-1e35-49ac-8d77-f5163c820281 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.714365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51eb22-1e35-49ac-8d77-f5163c820281 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.714635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51eb22-1e35-49ac-8d77-f5163c820281 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.721617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51eb22-1e35-49ac-8d77-f5163c820281 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.723117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51eb22-1e35-49ac-8d77-f5163c820281 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.739541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18834b-2668-43f1-add9-df0949eda675 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-3b51eb22-1e35-49ac-8d77-f5163c820281 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:08.740388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:08.741258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:08.742168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:08.742168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:08.742168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:08.742168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:08.742168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:08.742168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:08.742168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:08.742168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:08.747942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 331/676] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:08.747942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51eb22-1e35-49ac-8d77-f5163c820281 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.774288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8281c-a8bb-4934-a290-b6cf514cee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.774951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8281c-a8bb-4934-a290-b6cf514cee06 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.775231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8281c-a8bb-4934-a290-b6cf514cee06 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.775501 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8281c-a8bb-4934-a290-b6cf514cee06 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.776219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8281c-a8bb-4934-a290-b6cf514cee06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:08.776521 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8281c-a8bb-4934-a290-b6cf514cee06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.777880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8281c-a8bb-4934-a290-b6cf514cee06 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.793535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 346/677] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:08.794439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8281c-a8bb-4934-a290-b6cf514cee06 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.848020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51eb22-1e35-49ac-8d77-f5163c820281 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.882329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24a61-9b62-4806-a1df-a796b7616eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.883042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24a61-9b62-4806-a1df-a796b7616eaa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.883320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24a61-9b62-4806-a1df-a796b7616eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.883591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24a61-9b62-4806-a1df-a796b7616eaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.890393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad24a61-9b62-4806-a1df-a796b7616eaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.891882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad24a61-9b62-4806-a1df-a796b7616eaa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.892079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8281c-a8bb-4934-a290-b6cf514cee06 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-8ad24a61-9b62-4806-a1df-a796b7616eaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:08.906203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:08.908502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 332/678] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:08.910822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24a61-9b62-4806-a1df-a796b7616eaa None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:08.926278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa49964-45ac-489d-b33d-c35c80ea8841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:08.926944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa49964-45ac-489d-b33d-c35c80ea8841 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:08.927218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa49964-45ac-489d-b33d-c35c80ea8841 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:08.927487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa49964-45ac-489d-b33d-c35c80ea8841 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:08.928269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa49964-45ac-489d-b33d-c35c80ea8841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:08.928576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa49964-45ac-489d-b33d-c35c80ea8841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:08.930007 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa49964-45ac-489d-b33d-c35c80ea8841 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:08.942758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 347/679] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:08.943586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa49964-45ac-489d-b33d-c35c80ea8841 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:09.008124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24a61-9b62-4806-a1df-a796b7616eaa None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:09.041919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53d0e-7a66-40a1-b2d9-a98325f08a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:09.042740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53d0e-7a66-40a1-b2d9-a98325f08a57 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.043030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53d0e-7a66-40a1-b2d9-a98325f08a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.043301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53d0e-7a66-40a1-b2d9-a98325f08a57 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.045118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa49964-45ac-489d-b33d-c35c80ea8841 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:09.051125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f53d0e-7a66-40a1-b2d9-a98325f08a57 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:09.052667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f53d0e-7a66-40a1-b2d9-a98325f08a57 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-04f53d0e-7a66-40a1-b2d9-a98325f08a57 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:09.067893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:09.070406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 333/680] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:09.072785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53d0e-7a66-40a1-b2d9-a98325f08a57 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:09.091512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96bb3-20a2-4e1c-a6d7-780a2f8b2d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:09.092182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96bb3-20a2-4e1c-a6d7-780a2f8b2d34 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.092457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96bb3-20a2-4e1c-a6d7-780a2f8b2d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.092726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96bb3-20a2-4e1c-a6d7-780a2f8b2d34 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.093508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a96bb3-20a2-4e1c-a6d7-780a2f8b2d34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:09.093813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a96bb3-20a2-4e1c-a6d7-780a2f8b2d34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:09.095428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a96bb3-20a2-4e1c-a6d7-780a2f8b2d34 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:09.107896 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 348/681] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:09.108765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96bb3-20a2-4e1c-a6d7-780a2f8b2d34 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:09.169926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53d0e-7a66-40a1-b2d9-a98325f08a57 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:09.204012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbdab5-f407-4605-b55f-6553d88d639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:09.205389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdab5-f407-4605-b55f-6553d88d639c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.205558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96bb3-20a2-4e1c-a6d7-780a2f8b2d34 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:09.205716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdab5-f407-4605-b55f-6553d88d639c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.205883 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdab5-f407-4605-b55f-6553d88d639c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.207352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbdab5-f407-4605-b55f-6553d88d639c None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=55591aa3b6324ce99d1529beb8f6de2b) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:09.207352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbdab5-f407-4605-b55f-6553d88d639c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:09.208293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbdab5-f407-4605-b55f-6553d88d639c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:09.214794 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 334/682] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:09 2022] GET /identity/v3/role_assignments?user.id=55591aa3b6324ce99d1529beb8f6de2b&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:09.215599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbdab5-f407-4605-b55f-6553d88d639c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:09.240838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e4314-c65a-4940-9d84-b06023e81e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:09.241682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4314-c65a-4940-9d84-b06023e81e1a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.242317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4314-c65a-4940-9d84-b06023e81e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.242594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e4314-c65a-4940-9d84-b06023e81e1a None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.243723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e4314-c65a-4940-9d84-b06023e81e1a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:09.244028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e4314-c65a-4940-9d84-b06023e81e1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:09.246297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e4314-c65a-4940-9d84-b06023e81e1a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:09.271667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 349/683] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 16 14:56:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:09.277588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e4314-c65a-4940-9d84-b06023e81e1a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:09.328457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbdab5-f407-4605-b55f-6553d88d639c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:09.367690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d0ebd-8680-414f-864b-f1d7184218f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:09.370171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d0ebd-8680-414f-864b-f1d7184218f6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.370171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d0ebd-8680-414f-864b-f1d7184218f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.370171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d0ebd-8680-414f-864b-f1d7184218f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.370171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d0ebd-8680-414f-864b-f1d7184218f6 None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=aec8440b7bd84c2b9ce583a01adabf90) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:09.370501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d0ebd-8680-414f-864b-f1d7184218f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:09.372190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d0ebd-8680-414f-864b-f1d7184218f6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:09.380197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 335/684] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:09 2022] GET /identity/v3/role_assignments?user.id=aec8440b7bd84c2b9ce583a01adabf90&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:09.404178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e4314-c65a-4940-9d84-b06023e81e1a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:09.444297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841388a-64a7-495e-805c-ffd5f281a32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:09.444880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841388a-64a7-495e-805c-ffd5f281a32b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.445156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841388a-64a7-495e-805c-ffd5f281a32b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.445426 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841388a-64a7-495e-805c-ffd5f281a32b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.462935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028297-a957-4121-a657-e61f8d74bd22 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.463234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028297-a957-4121-a657-e61f8d74bd22 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.463610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028297-a957-4121-a657-e61f8d74bd22 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.465368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 336/685] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:09.471315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0aa1e-143e-4752-9eab-76dd8a57ec6d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.471712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0aa1e-143e-4752-9eab-76dd8a57ec6d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.472142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0aa1e-143e-4752-9eab-76dd8a57ec6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.507164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-23e0aa1e-143e-4752-9eab-76dd8a57ec6d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:09.508550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-23e0aa1e-143e-4752-9eab-76dd8a57ec6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:09.520551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841388a-64a7-495e-805c-ffd5f281a32b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:09.521968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841388a-64a7-495e-805c-ffd5f281a32b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:09.610027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 337/686] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:09.635590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0aa1e-143e-4752-9eab-76dd8a57ec6d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:09.640010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 350/687] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 14:56:09.646026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841388a-64a7-495e-805c-ffd5f281a32b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:09.751114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0aa1e-143e-4752-9eab-76dd8a57ec6d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:09.756855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841388a-64a7-495e-805c-ffd5f281a32b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:09.785947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64575337-4e23-44c5-9519-4f09bb6f16ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:09.786775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575337-4e23-44c5-9519-4f09bb6f16ad None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.787039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575337-4e23-44c5-9519-4f09bb6f16ad None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.787305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64575337-4e23-44c5-9519-4f09bb6f16ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.793384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202fd1-fd5a-484e-af22-424e9cbaa123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:09.794409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202fd1-fd5a-484e-af22-424e9cbaa123 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:09.794840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202fd1-fd5a-484e-af22-424e9cbaa123 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:09.795273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87202fd1-fd5a-484e-af22-424e9cbaa123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:09.797710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64575337-4e23-44c5-9519-4f09bb6f16ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:09.805714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87202fd1-fd5a-484e-af22-424e9cbaa123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-64575337-4e23-44c5-9519-4f09bb6f16ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:09.806100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:09.807230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:09.808460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 338/688] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:09.810824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87202fd1-fd5a-484e-af22-424e9cbaa123 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:09.812787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64575337-4e23-44c5-9519-4f09bb6f16ad None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-87202fd1-fd5a-484e-af22-424e9cbaa123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:09.829567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:09.831206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:09.832111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:09.832111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:09.832111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:09.832111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:09.834225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 351/689] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:09.840374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202fd1-fd5a-484e-af22-424e9cbaa123 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:09.980960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87202fd1-fd5a-484e-af22-424e9cbaa123 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:10.020464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64575337-4e23-44c5-9519-4f09bb6f16ad None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:10.023591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b70de-2647-496f-8551-9e7bdc534b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:10.024259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b70de-2647-496f-8551-9e7bdc534b69 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:10.024538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b70de-2647-496f-8551-9e7bdc534b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:10.024807 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b70de-2647-496f-8551-9e7bdc534b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:10.025538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b70de-2647-496f-8551-9e7bdc534b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:10.025837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b70de-2647-496f-8551-9e7bdc534b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:10.027242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b70de-2647-496f-8551-9e7bdc534b69 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:10.049604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 352/690] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:10.059145 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b70de-2647-496f-8551-9e7bdc534b69 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:10.087826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b2ab1-b92e-4491-9291-1284a453165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:10.088872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b2ab1-b92e-4491-9291-1284a453165b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:10.089351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b2ab1-b92e-4491-9291-1284a453165b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:10.089843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b2ab1-b92e-4491-9291-1284a453165b None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:10.090867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b2ab1-b92e-4491-9291-1284a453165b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:10.091369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b2ab1-b92e-4491-9291-1284a453165b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:10.092976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b2ab1-b92e-4491-9291-1284a453165b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:10.102811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 339/691] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:10.108305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b2ab1-b92e-4491-9291-1284a453165b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:10.168326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b70de-2647-496f-8551-9e7bdc534b69 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:10.207286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b2ab1-b92e-4491-9291-1284a453165b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:10.219648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eff5b-e81c-4db3-a1ed-271847721b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:10.221014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eff5b-e81c-4db3-a1ed-271847721b9b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:10.221294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eff5b-e81c-4db3-a1ed-271847721b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:10.221566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eff5b-e81c-4db3-a1ed-271847721b9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:10.232590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65eff5b-e81c-4db3-a1ed-271847721b9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:10.234049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65eff5b-e81c-4db3-a1ed-271847721b9b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:10.246556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03610f7e-b2a2-4a84-90bb-f3a457489d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:10.249363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03610f7e-b2a2-4a84-90bb-f3a457489d7f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:10.249891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03610f7e-b2a2-4a84-90bb-f3a457489d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:10.250380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03610f7e-b2a2-4a84-90bb-f3a457489d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:10.271862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03610f7e-b2a2-4a84-90bb-f3a457489d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-e65eff5b-e81c-4db3-a1ed-271847721b9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:10.272916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:10.273813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:10.274727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:10.274727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:10.274727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:10.274727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:10.274727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:10.274727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:10.274727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:10.274727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:10.277049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03610f7e-b2a2-4a84-90bb-f3a457489d7f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:10.279477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 353/692] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-03610f7e-b2a2-4a84-90bb-f3a457489d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:10.302605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:10.303527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:10.304408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:10.304408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:10.304408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:10.304408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:10.306478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eff5b-e81c-4db3-a1ed-271847721b9b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:10.313633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 340/693] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:10.316015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03610f7e-b2a2-4a84-90bb-f3a457489d7f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:10.480370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eff5b-e81c-4db3-a1ed-271847721b9b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:10.501008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03610f7e-b2a2-4a84-90bb-f3a457489d7f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:10.548004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2c043-3d67-451f-9613-99405f7234e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:10.549583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2c043-3d67-451f-9613-99405f7234e6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:10.550099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2c043-3d67-451f-9613-99405f7234e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:10.550569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2c043-3d67-451f-9613-99405f7234e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:10.552553 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2c043-3d67-451f-9613-99405f7234e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:10.553869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2c043-3d67-451f-9613-99405f7234e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:10.555754 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2c043-3d67-451f-9613-99405f7234e6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:10.569274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947849c8-a674-4396-939a-81e4d8c0b4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:10.570253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947849c8-a674-4396-939a-81e4d8c0b4ff None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:10.570731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947849c8-a674-4396-939a-81e4d8c0b4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:10.571193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947849c8-a674-4396-939a-81e4d8c0b4ff None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:10.572144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947849c8-a674-4396-939a-81e4d8c0b4ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:10.572646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947849c8-a674-4396-939a-81e4d8c0b4ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:10.574217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947849c8-a674-4396-939a-81e4d8c0b4ff None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:10.583535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 354/694] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:10.596197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2c043-3d67-451f-9613-99405f7234e6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:10.605687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 341/695] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:10.623400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947849c8-a674-4396-939a-81e4d8c0b4ff None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:10.779877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2c043-3d67-451f-9613-99405f7234e6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:10.803361 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947849c8-a674-4396-939a-81e4d8c0b4ff None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:10.846762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ce36a-b3bf-468f-a4d9-5c1a7ef6777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:10.847806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ce36a-b3bf-468f-a4d9-5c1a7ef6777c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:10.849556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ce36a-b3bf-468f-a4d9-5c1a7ef6777c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:10.850031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ce36a-b3bf-468f-a4d9-5c1a7ef6777c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:10.851430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ce36a-b3bf-468f-a4d9-5c1a7ef6777c None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=6a6668cb0bda4d61b6b96f547a422830) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:10.851944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ce36a-b3bf-468f-a4d9-5c1a7ef6777c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:10.853624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ce36a-b3bf-468f-a4d9-5c1a7ef6777c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:10.860744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 355/696] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:10 2022] GET /identity/v3/role_assignments?user.id=6a6668cb0bda4d61b6b96f547a422830&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:10.872743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1dfc7-19a6-49f9-b635-6ba4d0a0c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:10.873560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1dfc7-19a6-49f9-b635-6ba4d0a0c647 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:10.873834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1dfc7-19a6-49f9-b635-6ba4d0a0c647 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:10.874127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1dfc7-19a6-49f9-b635-6ba4d0a0c647 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:10.891608 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1dfc7-19a6-49f9-b635-6ba4d0a0c647 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:10.893638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1dfc7-19a6-49f9-b635-6ba4d0a0c647 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-22a1dfc7-19a6-49f9-b635-6ba4d0a0c647 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:10.914444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:10.915490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:10.916442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 342/697] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 16 14:56:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:10.921395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ce36a-b3bf-468f-a4d9-5c1a7ef6777c None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:11.063500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ce36a-b3bf-468f-a4d9-5c1a7ef6777c None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:11.106627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc4b61-9e13-424b-b98d-955c9bcc568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:11.107715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4b61-9e13-424b-b98d-955c9bcc568e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:11.108196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4b61-9e13-424b-b98d-955c9bcc568e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:11.108666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4b61-9e13-424b-b98d-955c9bcc568e None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:11.109781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc4b61-9e13-424b-b98d-955c9bcc568e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:11.110338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc4b61-9e13-424b-b98d-955c9bcc568e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:11.112541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc4b61-9e13-424b-b98d-955c9bcc568e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:11.131397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 356/698] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 16 14:56:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:11.136659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1dfc7-19a6-49f9-b635-6ba4d0a0c647 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:11.158648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4091-2589-4f68-aa72-15b4cea810c6 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:11.159255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4091-2589-4f68-aa72-15b4cea810c6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:11.159750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4091-2589-4f68-aa72-15b4cea810c6 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:11.162126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 357/699] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:11.178142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ae7bf-8917-4b4c-85d1-fafbb7f429ac None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:11.178142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ae7bf-8917-4b4c-85d1-fafbb7f429ac None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:11.178142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ae7bf-8917-4b4c-85d1-fafbb7f429ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:11.199139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f64ae7bf-8917-4b4c-85d1-fafbb7f429ac None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:11.200515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f64ae7bf-8917-4b4c-85d1-fafbb7f429ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:11.258448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1dfc7-19a6-49f9-b635-6ba4d0a0c647 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:11.290143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 358/700] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:11.298244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f05c2-937f-41cd-83ea-9255c2b18924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:11.299212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f05c2-937f-41cd-83ea-9255c2b18924 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:11.299737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f05c2-937f-41cd-83ea-9255c2b18924 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:11.300248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f05c2-937f-41cd-83ea-9255c2b18924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:11.317295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ae7bf-8917-4b4c-85d1-fafbb7f429ac None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:11.383418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f05c2-937f-41cd-83ea-9255c2b18924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:11.385047 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f05c2-937f-41cd-83ea-9255c2b18924 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:11.420966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ae7bf-8917-4b4c-85d1-fafbb7f429ac None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:11.457024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a9f07-652c-4e43-811e-82427378eb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:11.458133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a9f07-652c-4e43-811e-82427378eb70 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:11.458547 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a9f07-652c-4e43-811e-82427378eb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:11.458988 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a9f07-652c-4e43-811e-82427378eb70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:11.469587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a9f07-652c-4e43-811e-82427378eb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:11.471309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a9f07-652c-4e43-811e-82427378eb70 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-840a9f07-652c-4e43-811e-82427378eb70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:11.489163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:11.490317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:11.491387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:11.491387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:11.491387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:11.491387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:11.493157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 359/701] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:11.496606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 343/702] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:56:11.507104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a9f07-652c-4e43-811e-82427378eb70 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:11.507287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f05c2-937f-41cd-83ea-9255c2b18924 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:11.612093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a9f07-652c-4e43-811e-82427378eb70 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:11.624547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f05c2-937f-41cd-83ea-9255c2b18924 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:11.647373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb73b1-7026-42f5-b0d8-13855a2aa9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:11.648159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb73b1-7026-42f5-b0d8-13855a2aa9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:11.648443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb73b1-7026-42f5-b0d8-13855a2aa9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:11.648715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb73b1-7026-42f5-b0d8-13855a2aa9c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:11.659087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb73b1-7026-42f5-b0d8-13855a2aa9c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:11.660516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb73b1-7026-42f5-b0d8-13855a2aa9c6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:11.663732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f2f0e-394a-4d0c-a6bb-54ff83b24fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:11.664558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f2f0e-394a-4d0c-a6bb-54ff83b24fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:11.664999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f2f0e-394a-4d0c-a6bb-54ff83b24fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:11.665412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f2f0e-394a-4d0c-a6bb-54ff83b24fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:11.666308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f2f0e-394a-4d0c-a6bb-54ff83b24fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:11.667138 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f2f0e-394a-4d0c-a6bb-54ff83b24fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:11.669208 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f2f0e-394a-4d0c-a6bb-54ff83b24fe8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-7dfb73b1-7026-42f5-b0d8-13855a2aa9c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:11.678010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:11.679110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:11.680170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:11.680170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:11.680170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:11.680170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:11.680170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 360/703] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:11.687540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb73b1-7026-42f5-b0d8-13855a2aa9c6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:11.689125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 344/704] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:11.695164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f2f0e-394a-4d0c-a6bb-54ff83b24fe8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:11.800695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb73b1-7026-42f5-b0d8-13855a2aa9c6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:11.835318 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8300c-1338-490c-b7f3-3ca999563bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:11.837471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8300c-1338-490c-b7f3-3ca999563bed None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:11.837471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8300c-1338-490c-b7f3-3ca999563bed None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:11.837471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8300c-1338-490c-b7f3-3ca999563bed None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:11.838185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8300c-1338-490c-b7f3-3ca999563bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:11.838719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8300c-1338-490c-b7f3-3ca999563bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:11.840280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8300c-1338-490c-b7f3-3ca999563bed None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:11.853447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 361/705] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:11.859399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8300c-1338-490c-b7f3-3ca999563bed None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:11.953780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f2f0e-394a-4d0c-a6bb-54ff83b24fe8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:11.963250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8300c-1338-490c-b7f3-3ca999563bed None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:11.996678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67708b-c134-46cc-8c52-24677b27878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:11.997710 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67708b-c134-46cc-8c52-24677b27878a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.003605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67708b-c134-46cc-8c52-24677b27878a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.004134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67708b-c134-46cc-8c52-24677b27878a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.011557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67708b-c134-46cc-8c52-24677b27878a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:12.013192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67708b-c134-46cc-8c52-24677b27878a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-3f67708b-c134-46cc-8c52-24677b27878a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:12.031424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:12.032567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:12.034027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:12.034027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:12.034027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:12.034027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:12.034027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:12.034027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:12.034027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:12.034027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:12.034027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 362/706] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:12.039083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b357e-c367-4c04-91ae-eca8a7b08d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:12.039785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b357e-c367-4c04-91ae-eca8a7b08d46 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.040082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b357e-c367-4c04-91ae-eca8a7b08d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.040341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b357e-c367-4c04-91ae-eca8a7b08d46 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.041182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b357e-c367-4c04-91ae-eca8a7b08d46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:12.043168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67708b-c134-46cc-8c52-24677b27878a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:12.044143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b357e-c367-4c04-91ae-eca8a7b08d46 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:12.153474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 345/707] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:56:11 2022] POST /identity/v3/users => generated 254 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:12.155454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2185473-2298-454c-a311-d3e5d993a3a7 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.155983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2185473-2298-454c-a311-d3e5d993a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.156537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2185473-2298-454c-a311-d3e5d993a3a7 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.156645 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67708b-c134-46cc-8c52-24677b27878a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:12.162252 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 346/708] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:12.165424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1f388-9b50-47e3-816a-98866f8f901e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.165946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1f388-9b50-47e3-816a-98866f8f901e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.166488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1f388-9b50-47e3-816a-98866f8f901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.185494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9ae1f388-9b50-47e3-816a-98866f8f901e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:12.187193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9ae1f388-9b50-47e3-816a-98866f8f901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:12.193798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5857e7-3573-4b82-8998-cc6229ed98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:12.194508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5857e7-3573-4b82-8998-cc6229ed98b6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.194794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5857e7-3573-4b82-8998-cc6229ed98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.195069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5857e7-3573-4b82-8998-cc6229ed98b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.195877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5857e7-3573-4b82-8998-cc6229ed98b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:12.196186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5857e7-3573-4b82-8998-cc6229ed98b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:12.197671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5857e7-3573-4b82-8998-cc6229ed98b6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:12.216576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 363/709] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:12.218237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5857e7-3573-4b82-8998-cc6229ed98b6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:12.270657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 347/710] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:12.294524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1f388-9b50-47e3-816a-98866f8f901e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:12.332429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5857e7-3573-4b82-8998-cc6229ed98b6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:12.371274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3512e9-153e-4291-b6ad-3249c58b1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:12.371956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3512e9-153e-4291-b6ad-3249c58b1236 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.372363 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3512e9-153e-4291-b6ad-3249c58b1236 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.372558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3512e9-153e-4291-b6ad-3249c58b1236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.373406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3512e9-153e-4291-b6ad-3249c58b1236 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=dc19a5d9ce774f39aa49ab7c64ba682e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:12.373719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3512e9-153e-4291-b6ad-3249c58b1236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:12.375367 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3512e9-153e-4291-b6ad-3249c58b1236 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:12.382040 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 364/711] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:12 2022] GET /identity/v3/role_assignments?user.id=dc19a5d9ce774f39aa49ab7c64ba682e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=042169a166e14a80beac826291ceaf73 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:12.391816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf492-773d-4c9a-a431-b4230a28367a None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.392221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf492-773d-4c9a-a431-b4230a28367a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.392506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf492-773d-4c9a-a431-b4230a28367a None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.394249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 365/712] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:12.399890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33629b-0012-471c-bcf2-47d5b2797fdc None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.400223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33629b-0012-471c-bcf2-47d5b2797fdc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.400510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33629b-0012-471c-bcf2-47d5b2797fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.414331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1f388-9b50-47e3-816a-98866f8f901e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:12.434819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-6b33629b-0012-471c-bcf2-47d5b2797fdc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:12.436061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6b33629b-0012-471c-bcf2-47d5b2797fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:12.461395 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103aa8-20c9-4067-8b07-f8da36f4e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:12.462917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103aa8-20c9-4067-8b07-f8da36f4e61a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.463933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103aa8-20c9-4067-8b07-f8da36f4e61a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.464480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103aa8-20c9-4067-8b07-f8da36f4e61a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.465684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f103aa8-20c9-4067-8b07-f8da36f4e61a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:12.468212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f103aa8-20c9-4067-8b07-f8da36f4e61a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-3f103aa8-20c9-4067-8b07-f8da36f4e61a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:12.488695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:12.489750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:56:12.490638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:12.494132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 348/713] 10.222.0.44 () {56 vars in 1129 bytes} [Mon May 16 14:56:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:12.500723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103aa8-20c9-4067-8b07-f8da36f4e61a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:12.530191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 366/714] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:56:12.557760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33629b-0012-471c-bcf2-47d5b2797fdc None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:12.646499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103aa8-20c9-4067-8b07-f8da36f4e61a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:12.672658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33629b-0012-471c-bcf2-47d5b2797fdc None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:12.689785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee0212-dc3f-410a-a020-e2a56372e724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:12.691021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee0212-dc3f-410a-a020-e2a56372e724 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.691799 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee0212-dc3f-410a-a020-e2a56372e724 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.692293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee0212-dc3f-410a-a020-e2a56372e724 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.693223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee0212-dc3f-410a-a020-e2a56372e724 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:12.693733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee0212-dc3f-410a-a020-e2a56372e724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:12.696107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee0212-dc3f-410a-a020-e2a56372e724 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:12.703338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 349/715] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 16 14:56:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:12.711419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee0212-dc3f-410a-a020-e2a56372e724 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:12.714718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e05fc-286c-4c27-9f5f-4f96b483d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:12.715525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e05fc-286c-4c27-9f5f-4f96b483d93c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.715804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e05fc-286c-4c27-9f5f-4f96b483d93c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.716077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e05fc-286c-4c27-9f5f-4f96b483d93c None admin] PATH_INFO: `/v3/services/network` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.716862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e05fc-286c-4c27-9f5f-4f96b483d93c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:12.718696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e05fc-286c-4c27-9f5f-4f96b483d93c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-747e05fc-286c-4c27-9f5f-4f96b483d93c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:12.733289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:12.734648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:12.739654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 367/716] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:12 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:12.743305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e05fc-286c-4c27-9f5f-4f96b483d93c None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:12.847180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee0212-dc3f-410a-a020-e2a56372e724 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:12.885388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d018979-7842-4739-a70c-a67e2ecaae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:12.886075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d018979-7842-4739-a70c-a67e2ecaae35 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.886644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d018979-7842-4739-a70c-a67e2ecaae35 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.886926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d018979-7842-4739-a70c-a67e2ecaae35 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.887632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d018979-7842-4739-a70c-a67e2ecaae35 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:12.888094 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d018979-7842-4739-a70c-a67e2ecaae35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:12.889543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d018979-7842-4739-a70c-a67e2ecaae35 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:12.896287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 350/717] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 16 14:56:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:12.930336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e05fc-286c-4c27-9f5f-4f96b483d93c None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:12.984929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505be60-97af-4b55-a190-d5873ce6918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:12.985511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505be60-97af-4b55-a190-d5873ce6918f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:12.985789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505be60-97af-4b55-a190-d5873ce6918f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:12.986184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505be60-97af-4b55-a190-d5873ce6918f None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:12.986889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505be60-97af-4b55-a190-d5873ce6918f None admin] RBAC: Adding query filter params (name=network) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:12.987190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505be60-97af-4b55-a190-d5873ce6918f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:12.988543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505be60-97af-4b55-a190-d5873ce6918f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:12.993316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 368/718] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:12.999205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d018979-7842-4739-a70c-a67e2ecaae35 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:13.172068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d018979-7842-4739-a70c-a67e2ecaae35 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:13.207240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616534e3-c5af-4d07-899f-eccbb95d8e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:13.208142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616534e3-c5af-4d07-899f-eccbb95d8e9b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:13.208586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616534e3-c5af-4d07-899f-eccbb95d8e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:13.209012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616534e3-c5af-4d07-899f-eccbb95d8e9b None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:13.209851 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616534e3-c5af-4d07-899f-eccbb95d8e9b None admin] RBAC: Adding query filter params (type=network) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:13.210342 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616534e3-c5af-4d07-899f-eccbb95d8e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:13.211840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616534e3-c5af-4d07-899f-eccbb95d8e9b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:13.218861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 351/719] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:13.811333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a205b-9a71-4df8-b211-e37e130c7452 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:13.811856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a205b-9a71-4df8-b211-e37e130c7452 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:13.811856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a205b-9a71-4df8-b211-e37e130c7452 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:13.813458 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 369/720] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:13.819457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285513d-3724-4d4c-9e0d-2bf573840cd6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:13.819900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285513d-3724-4d4c-9e0d-2bf573840cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:13.820011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285513d-3724-4d4c-9e0d-2bf573840cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:13.847331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8285513d-3724-4d4c-9e0d-2bf573840cd6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:13.848545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8285513d-3724-4d4c-9e0d-2bf573840cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:13.947351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 352/721] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:13.977160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a205b-9a71-4df8-b211-e37e130c7452 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:14.092035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a205b-9a71-4df8-b211-e37e130c7452 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:14.140543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa49c5-3c67-44e6-83bf-fa85f3978458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:14.141658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa49c5-3c67-44e6-83bf-fa85f3978458 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:14.142188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa49c5-3c67-44e6-83bf-fa85f3978458 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:14.142682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa49c5-3c67-44e6-83bf-fa85f3978458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:14.158177 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa49c5-3c67-44e6-83bf-fa85f3978458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-6daa49c5-3c67-44e6-83bf-fa85f3978458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:14.165803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:14.166831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:14.167662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:14.169942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 370/722] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:14.178559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285513d-3724-4d4c-9e0d-2bf573840cd6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:14.301076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285513d-3724-4d4c-9e0d-2bf573840cd6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:14.347107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78056538-9b6b-4c53-8da1-4d7c4e1afbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:14.348056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78056538-9b6b-4c53-8da1-4d7c4e1afbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:14.348497 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78056538-9b6b-4c53-8da1-4d7c4e1afbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:14.348914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78056538-9b6b-4c53-8da1-4d7c4e1afbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:14.349800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78056538-9b6b-4c53-8da1-4d7c4e1afbe0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:14.350287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78056538-9b6b-4c53-8da1-4d7c4e1afbe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:14.351791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78056538-9b6b-4c53-8da1-4d7c4e1afbe0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:14.365365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 353/723] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:14.370945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa49c5-3c67-44e6-83bf-fa85f3978458 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:14.495538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa49c5-3c67-44e6-83bf-fa85f3978458 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:14.542356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406eb22-3dc9-493a-9f96-30bbf919c6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:14.543388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406eb22-3dc9-493a-9f96-30bbf919c6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:14.543843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406eb22-3dc9-493a-9f96-30bbf919c6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:14.544257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406eb22-3dc9-493a-9f96-30bbf919c6d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:14.558819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406eb22-3dc9-493a-9f96-30bbf919c6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:14.560447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406eb22-3dc9-493a-9f96-30bbf919c6d8 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-e406eb22-3dc9-493a-9f96-30bbf919c6d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:14.581284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:14.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:14.583512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:14.583512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:14.583512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:14.583512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:14.585339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 371/724] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:14.590985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78056538-9b6b-4c53-8da1-4d7c4e1afbe0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:14.741977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78056538-9b6b-4c53-8da1-4d7c4e1afbe0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:14.792141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24661f-72b7-4107-8f56-dcd67bd8545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:14.792818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24661f-72b7-4107-8f56-dcd67bd8545d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:14.793101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24661f-72b7-4107-8f56-dcd67bd8545d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:14.793370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24661f-72b7-4107-8f56-dcd67bd8545d None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:14.794117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24661f-72b7-4107-8f56-dcd67bd8545d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:14.794425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24661f-72b7-4107-8f56-dcd67bd8545d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:14.795783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24661f-72b7-4107-8f56-dcd67bd8545d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:14.811723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 354/725] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:14.817238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406eb22-3dc9-493a-9f96-30bbf919c6d8 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:14.955878 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406eb22-3dc9-493a-9f96-30bbf919c6d8 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:15.005349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa13a82-b2d7-4301-acf6-12860853c7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:15.005349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa13a82-b2d7-4301-acf6-12860853c7dc None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.005349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa13a82-b2d7-4301-acf6-12860853c7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.005349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa13a82-b2d7-4301-acf6-12860853c7dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.019134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa13a82-b2d7-4301-acf6-12860853c7dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:15.020638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa13a82-b2d7-4301-acf6-12860853c7dc None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-1aa13a82-b2d7-4301-acf6-12860853c7dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:15.038433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:15.039393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:15.040326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:15.044209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 372/726] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:15.045551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24661f-72b7-4107-8f56-dcd67bd8545d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:15.200167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24661f-72b7-4107-8f56-dcd67bd8545d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:15.240133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91e696-9738-43d9-895a-41d7d013711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:15.241151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91e696-9738-43d9-895a-41d7d013711b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.241629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91e696-9738-43d9-895a-41d7d013711b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.242140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91e696-9738-43d9-895a-41d7d013711b None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.243161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91e696-9738-43d9-895a-41d7d013711b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:15.243663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91e696-9738-43d9-895a-41d7d013711b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:15.245278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91e696-9738-43d9-895a-41d7d013711b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:15.256341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d63b48-bcce-433d-ad4a-19e74917fb11 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.256612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d63b48-bcce-433d-ad4a-19e74917fb11 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.256891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d63b48-bcce-433d-ad4a-19e74917fb11 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.258461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 373/727] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:15.263152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e113b-00ef-42ff-8c8a-dbd6fb883400 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.263436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e113b-00ef-42ff-8c8a-dbd6fb883400 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.263716 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e113b-00ef-42ff-8c8a-dbd6fb883400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.268266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 355/728] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 16 14:56:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:15.274085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91e696-9738-43d9-895a-41d7d013711b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:15.299192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f26e113b-00ef-42ff-8c8a-dbd6fb883400 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:15.300722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f26e113b-00ef-42ff-8c8a-dbd6fb883400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:15.396770 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91e696-9738-43d9-895a-41d7d013711b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:15.410073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 374/729] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:56:15.411642 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d31d0-3d83-4d41-b154-9a1c2d77749d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.412077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d31d0-3d83-4d41-b154-9a1c2d77749d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.412508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d31d0-3d83-4d41-b154-9a1c2d77749d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.418025 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 375/730] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:15.419169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d4c6e-fb3a-42b1-8212-b2dd91eab284 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.419456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d4c6e-fb3a-42b1-8212-b2dd91eab284 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.419731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d4c6e-fb3a-42b1-8212-b2dd91eab284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.432508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973c02-e2c3-4f6f-8e98-ffc1b2949486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:15.433368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973c02-e2c3-4f6f-8e98-ffc1b2949486 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.433818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973c02-e2c3-4f6f-8e98-ffc1b2949486 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.434340 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973c02-e2c3-4f6f-8e98-ffc1b2949486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.437692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-706d4c6e-fb3a-42b1-8212-b2dd91eab284 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:15.442085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-706d4c6e-fb3a-42b1-8212-b2dd91eab284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:15.512188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 376/731] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 14:56:15.512952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d4c6e-fb3a-42b1-8212-b2dd91eab284 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:15.529688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973c02-e2c3-4f6f-8e98-ffc1b2949486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:15.531191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973c02-e2c3-4f6f-8e98-ffc1b2949486 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:15.640957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 356/732] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 14:56:15.641820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973c02-e2c3-4f6f-8e98-ffc1b2949486 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:15.643690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d4c6e-fb3a-42b1-8212-b2dd91eab284 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:15.678786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7a77d-0719-4657-876e-ba4cea9c69b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:15.679582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7a77d-0719-4657-876e-ba4cea9c69b8 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.679859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7a77d-0719-4657-876e-ba4cea9c69b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.680131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7a77d-0719-4657-876e-ba4cea9c69b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.691660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7a77d-0719-4657-876e-ba4cea9c69b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-66e7a77d-0719-4657-876e-ba4cea9c69b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:15.699325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:15.700229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:15.701544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 377/733] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:15.702262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7a77d-0719-4657-876e-ba4cea9c69b8 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:15.745725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973c02-e2c3-4f6f-8e98-ffc1b2949486 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:15.781815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5427b-9dc1-4237-b1ff-e9178223f126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:15.782568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5427b-9dc1-4237-b1ff-e9178223f126 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.783387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5427b-9dc1-4237-b1ff-e9178223f126 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.783663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5427b-9dc1-4237-b1ff-e9178223f126 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.795192 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5427b-9dc1-4237-b1ff-e9178223f126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-91a5427b-9dc1-4237-b1ff-e9178223f126 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:15.802827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:15.803750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:15.804631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 357/734] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:15.805971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5427b-9dc1-4237-b1ff-e9178223f126 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:15.812701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7a77d-0719-4657-876e-ba4cea9c69b8 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:15.845248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00658bbb-6927-4776-9e9b-dcee023d68c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:15.846614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658bbb-6927-4776-9e9b-dcee023d68c5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.846887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658bbb-6927-4776-9e9b-dcee023d68c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.847151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00658bbb-6927-4776-9e9b-dcee023d68c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.857488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00658bbb-6927-4776-9e9b-dcee023d68c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:15.858999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00658bbb-6927-4776-9e9b-dcee023d68c5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-00658bbb-6927-4776-9e9b-dcee023d68c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:15.875252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:15.876218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:15.877206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:15.877206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:15.877206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:15.877206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:15.877206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 378/735] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:15.877901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ea33-38d7-4a47-be5b-f4f3c70914e5 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.877998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ea33-38d7-4a47-be5b-f4f3c70914e5 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.878313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ea33-38d7-4a47-be5b-f4f3c70914e5 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.879759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 379/736] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:15.881667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ea33-38d7-4a47-be5b-f4f3c70914e5 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:15.912185 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5427b-9dc1-4237-b1ff-e9178223f126 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:15.947984 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71409953-7035-45f6-bf9f-645effe444ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:15.948740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409953-7035-45f6-bf9f-645effe444ce None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:15.949054 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409953-7035-45f6-bf9f-645effe444ce None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:15.949338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71409953-7035-45f6-bf9f-645effe444ce None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:15.950091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409953-7035-45f6-bf9f-645effe444ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:15.950402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409953-7035-45f6-bf9f-645effe444ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:15.951785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71409953-7035-45f6-bf9f-645effe444ce None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:15.960284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 358/737] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:56:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:15.961108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71409953-7035-45f6-bf9f-645effe444ce None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:15.982936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ea33-38d7-4a47-be5b-f4f3c70914e5 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.014432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbc138-218c-4979-8866-062f9fb9f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.015088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbc138-218c-4979-8866-062f9fb9f755 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.015364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbc138-218c-4979-8866-062f9fb9f755 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.015634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbc138-218c-4979-8866-062f9fb9f755 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.016369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbc138-218c-4979-8866-062f9fb9f755 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:16.016672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbc138-218c-4979-8866-062f9fb9f755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.018616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbc138-218c-4979-8866-062f9fb9f755 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.026780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 380/738] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:16.028035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3051-7c45-48cc-83ec-981a3f0ea904 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.028496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3051-7c45-48cc-83ec-981a3f0ea904 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.028773 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3051-7c45-48cc-83ec-981a3f0ea904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.044013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-dc8a3051-7c45-48cc-83ec-981a3f0ea904 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:16.045171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-dc8a3051-7c45-48cc-83ec-981a3f0ea904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:16.057591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71409953-7035-45f6-bf9f-645effe444ce None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.090238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023262-ca47-4bc6-8eb6-e69ad98ef12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.090904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023262-ca47-4bc6-8eb6-e69ad98ef12a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.091189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023262-ca47-4bc6-8eb6-e69ad98ef12a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.091465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023262-ca47-4bc6-8eb6-e69ad98ef12a None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.092183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023262-ca47-4bc6-8eb6-e69ad98ef12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:16.092491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023262-ca47-4bc6-8eb6-e69ad98ef12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.093866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023262-ca47-4bc6-8eb6-e69ad98ef12a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.105095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 359/739] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:16.106334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdfc0b-3f37-472a-9e8b-2ba087fdbec4 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.122259 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdfc0b-3f37-472a-9e8b-2ba087fdbec4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.122413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 381/740] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:16.122548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdfc0b-3f37-472a-9e8b-2ba087fdbec4 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.122640 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3051-7c45-48cc-83ec-981a3f0ea904 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.122725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 360/741] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:16.122725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdfc0b-3f37-472a-9e8b-2ba087fdbec4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.199847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3051-7c45-48cc-83ec-981a3f0ea904 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.218156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdfc0b-3f37-472a-9e8b-2ba087fdbec4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.231207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d58f-ec2e-43da-aad3-1dc60c6c6032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.231993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d58f-ec2e-43da-aad3-1dc60c6c6032 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.232270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d58f-ec2e-43da-aad3-1dc60c6c6032 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.232541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d58f-ec2e-43da-aad3-1dc60c6c6032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.242967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57d58f-ec2e-43da-aad3-1dc60c6c6032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.244390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57d58f-ec2e-43da-aad3-1dc60c6c6032 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.250603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f411e1-9d80-47e7-9acf-d74b99dba854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.251394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f411e1-9d80-47e7-9acf-d74b99dba854 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.251716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f411e1-9d80-47e7-9acf-d74b99dba854 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.251988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f411e1-9d80-47e7-9acf-d74b99dba854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-4b57d58f-ec2e-43da-aad3-1dc60c6c6032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:16.260976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:16.262043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:16.262973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:16.262973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:16.262973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:16.262973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:16.263668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f411e1-9d80-47e7-9acf-d74b99dba854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.263756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 382/742] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:16.263756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d58f-ec2e-43da-aad3-1dc60c6c6032 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.263913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f411e1-9d80-47e7-9acf-d74b99dba854 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-73f411e1-9d80-47e7-9acf-d74b99dba854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:16.282251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:16.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:16.284822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:16.284822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:16.284822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:16.284822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:16.286349 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 361/743] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:16.287408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c732491-c898-4097-ad4a-0fe74c551480 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.287686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c732491-c898-4097-ad4a-0fe74c551480 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.287956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c732491-c898-4097-ad4a-0fe74c551480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.303965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9c732491-c898-4097-ad4a-0fe74c551480 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:16.305062 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9c732491-c898-4097-ad4a-0fe74c551480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:16.359744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d58f-ec2e-43da-aad3-1dc60c6c6032 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.367789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 362/744] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 14:56:16.368573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c732491-c898-4097-ad4a-0fe74c551480 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.391401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a2771-0f2b-4105-bc49-e3066ffff050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.392704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a2771-0f2b-4105-bc49-e3066ffff050 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.392985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a2771-0f2b-4105-bc49-e3066ffff050 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.393254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a2771-0f2b-4105-bc49-e3066ffff050 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.399678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a2771-0f2b-4105-bc49-e3066ffff050 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.401103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a2771-0f2b-4105-bc49-e3066ffff050 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-920a2771-0f2b-4105-bc49-e3066ffff050 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:16.414756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:16.415704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:16.416625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:16.416625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:16.416625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:16.416625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:16.416625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:16.416625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:16.416625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:16.416625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:16.416625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 383/745] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:16.417091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a2771-0f2b-4105-bc49-e3066ffff050 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.468473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c732491-c898-4097-ad4a-0fe74c551480 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.499722 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1a567-c72b-442b-93d2-2609bd8b9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.500374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1a567-c72b-442b-93d2-2609bd8b9648 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.500648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1a567-c72b-442b-93d2-2609bd8b9648 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.500925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1a567-c72b-442b-93d2-2609bd8b9648 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.501628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1a567-c72b-442b-93d2-2609bd8b9648 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.503017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1a567-c72b-442b-93d2-2609bd8b9648 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.508151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a2771-0f2b-4105-bc49-e3066ffff050 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.540260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf84e3f-23a1-40f5-8bde-2f4281139bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.540908 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf84e3f-23a1-40f5-8bde-2f4281139bdb None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.541190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf84e3f-23a1-40f5-8bde-2f4281139bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf84e3f-23a1-40f5-8bde-2f4281139bdb None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.542207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf84e3f-23a1-40f5-8bde-2f4281139bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:16.542511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf84e3f-23a1-40f5-8bde-2f4281139bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.543856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf84e3f-23a1-40f5-8bde-2f4281139bdb None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.554957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 384/746] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:16.555685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf84e3f-23a1-40f5-8bde-2f4281139bdb None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.609723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 363/747] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:56:16 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:16.610558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1a567-c72b-442b-93d2-2609bd8b9648 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.655118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf84e3f-23a1-40f5-8bde-2f4281139bdb None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.699636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c54bf7-1a4b-4395-9714-f6a196181ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.700487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c54bf7-1a4b-4395-9714-f6a196181ccf None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.700771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c54bf7-1a4b-4395-9714-f6a196181ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.701462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c54bf7-1a4b-4395-9714-f6a196181ccf None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.702510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c54bf7-1a4b-4395-9714-f6a196181ccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:16.702840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c54bf7-1a4b-4395-9714-f6a196181ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.705316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c54bf7-1a4b-4395-9714-f6a196181ccf None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.717542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 385/748] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:16.718894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c54bf7-1a4b-4395-9714-f6a196181ccf None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.727588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1a567-c72b-442b-93d2-2609bd8b9648 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.767852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008c032-925c-49ee-9f45-b5d5fc731e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.768532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c032-925c-49ee-9f45-b5d5fc731e13 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.768812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c032-925c-49ee-9f45-b5d5fc731e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.769103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c032-925c-49ee-9f45-b5d5fc731e13 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.769820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008c032-925c-49ee-9f45-b5d5fc731e13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.771265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008c032-925c-49ee-9f45-b5d5fc731e13 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.818546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c54bf7-1a4b-4395-9714-f6a196181ccf None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.845756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 364/749] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:56:16 2022] POST /identity/v3/services => generated 240 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:16.846665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008c032-925c-49ee-9f45-b5d5fc731e13 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.864983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9a9a-74e2-406d-b4d7-7b510ab36f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:16.866318 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9a9a-74e2-406d-b4d7-7b510ab36f63 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:16.866820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9a9a-74e2-406d-b4d7-7b510ab36f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:16.867258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9a9a-74e2-406d-b4d7-7b510ab36f63 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:16.868282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9a9a-74e2-406d-b4d7-7b510ab36f63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:16.868777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9a9a-74e2-406d-b4d7-7b510ab36f63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:16.870438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9a9a-74e2-406d-b4d7-7b510ab36f63 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:16.885214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 386/750] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:16.886437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9a9a-74e2-406d-b4d7-7b510ab36f63 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:16.961442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008c032-925c-49ee-9f45-b5d5fc731e13 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.995114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9a9a-74e2-406d-b4d7-7b510ab36f63 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:16.998013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41fa3b-5f8f-4482-a1db-c2769e6618da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:17.004635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41fa3b-5f8f-4482-a1db-c2769e6618da None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:17.004970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41fa3b-5f8f-4482-a1db-c2769e6618da None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:17.005322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41fa3b-5f8f-4482-a1db-c2769e6618da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:17.013984 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41fa3b-5f8f-4482-a1db-c2769e6618da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:17.015638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41fa3b-5f8f-4482-a1db-c2769e6618da None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-fe41fa3b-5f8f-4482-a1db-c2769e6618da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:17.031220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:17.032442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:17.034198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 365/751] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:56:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:17.035115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41fa3b-5f8f-4482-a1db-c2769e6618da None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:17.040852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6f99c-c46e-4824-8f92-f2c602629d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:17.041895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6f99c-c46e-4824-8f92-f2c602629d61 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:17.042377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6f99c-c46e-4824-8f92-f2c602629d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:17.042838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6f99c-c46e-4824-8f92-f2c602629d61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:17.052007 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6f99c-c46e-4824-8f92-f2c602629d61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:17.053455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6f99c-c46e-4824-8f92-f2c602629d61 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-f2e6f99c-c46e-4824-8f92-f2c602629d61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:17.069826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:17.070963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 387/752] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 16 14:56:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:17.072233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6f99c-c46e-4824-8f92-f2c602629d61 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:17.143652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41fa3b-5f8f-4482-a1db-c2769e6618da None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:17.182478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b692-1c88-4a92-9cf4-26597ba5cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:17.183401 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b692-1c88-4a92-9cf4-26597ba5cb4e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:17.183861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b692-1c88-4a92-9cf4-26597ba5cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:17.184283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b692-1c88-4a92-9cf4-26597ba5cb4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:17.185274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b692-1c88-4a92-9cf4-26597ba5cb4e None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=6a6668cb0bda4d61b6b96f547a422830) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:17.185755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b692-1c88-4a92-9cf4-26597ba5cb4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:17.187433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b692-1c88-4a92-9cf4-26597ba5cb4e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:17.194536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 366/753] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:17 2022] GET /identity/v3/role_assignments?user.id=6a6668cb0bda4d61b6b96f547a422830&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=042169a166e14a80beac826291ceaf73 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:17.195666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b692-1c88-4a92-9cf4-26597ba5cb4e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:17.303042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b692-1c88-4a92-9cf4-26597ba5cb4e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:17.323257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6f99c-c46e-4824-8f92-f2c602629d61 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:17.347009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb9b0a-b603-4bbc-a766-0e8d64fe9278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:17.347721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb9b0a-b603-4bbc-a766-0e8d64fe9278 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:17.348007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb9b0a-b603-4bbc-a766-0e8d64fe9278 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:17.348286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb9b0a-b603-4bbc-a766-0e8d64fe9278 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:17.349308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb9b0a-b603-4bbc-a766-0e8d64fe9278 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:17.349437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb9b0a-b603-4bbc-a766-0e8d64fe9278 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:17.350977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb9b0a-b603-4bbc-a766-0e8d64fe9278 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:17.381471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004792a-12f3-427b-8be2-d8a32e746b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:17.382706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004792a-12f3-427b-8be2-d8a32e746b92 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:17.382706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004792a-12f3-427b-8be2-d8a32e746b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:17.382706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004792a-12f3-427b-8be2-d8a32e746b92 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:17.383575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004792a-12f3-427b-8be2-d8a32e746b92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:17.383879 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004792a-12f3-427b-8be2-d8a32e746b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:17.385335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004792a-12f3-427b-8be2-d8a32e746b92 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:17.387496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 367/754] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 16 14:56:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:17.393757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb9b0a-b603-4bbc-a766-0e8d64fe9278 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:17.420911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 388/755] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 16 14:56:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:17.427333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004792a-12f3-427b-8be2-d8a32e746b92 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:17.539270 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb9b0a-b603-4bbc-a766-0e8d64fe9278 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:17.581177 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004792a-12f3-427b-8be2-d8a32e746b92 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:17.581993 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dd2a7-526a-443f-a9a8-e427c2dc2568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:17.583038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dd2a7-526a-443f-a9a8-e427c2dc2568 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:17.583548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dd2a7-526a-443f-a9a8-e427c2dc2568 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:17.584023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dd2a7-526a-443f-a9a8-e427c2dc2568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:17.602885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dd2a7-526a-443f-a9a8-e427c2dc2568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:17.604603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dd2a7-526a-443f-a9a8-e427c2dc2568 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:17.623358 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcebe2-e217-4ae9-a142-d686b0e0205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:17.624060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcebe2-e217-4ae9-a142-d686b0e0205f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:17.624346 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcebe2-e217-4ae9-a142-d686b0e0205f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:17.624625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcebe2-e217-4ae9-a142-d686b0e0205f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-889dd2a7-526a-443f-a9a8-e427c2dc2568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:17.643907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:17.644847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:17.645748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:17.645748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:17.645748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:17.645748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:17.647368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 368/756] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:17.653556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dd2a7-526a-443f-a9a8-e427c2dc2568 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:17.747373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcebe2-e217-4ae9-a142-d686b0e0205f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:17.752005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcebe2-e217-4ae9-a142-d686b0e0205f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:17.853593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 389/757] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:56:17.858994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcebe2-e217-4ae9-a142-d686b0e0205f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:17.861778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dd2a7-526a-443f-a9a8-e427c2dc2568 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:17.912068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adc244-f087-44af-a891-9e9278149aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:17.912732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adc244-f087-44af-a891-9e9278149aad None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:17.913009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adc244-f087-44af-a891-9e9278149aad None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:17.913277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adc244-f087-44af-a891-9e9278149aad None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:17.913994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adc244-f087-44af-a891-9e9278149aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:17.914317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adc244-f087-44af-a891-9e9278149aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:17.915678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adc244-f087-44af-a891-9e9278149aad None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:17.928970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 369/758] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:17.933866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adc244-f087-44af-a891-9e9278149aad None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:18.043515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcebe2-e217-4ae9-a142-d686b0e0205f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:18.108627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d467a8-0d04-4ed3-abc6-724181e1d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:18.109327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d467a8-0d04-4ed3-abc6-724181e1d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:18.109598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d467a8-0d04-4ed3-abc6-724181e1d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:18.109867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d467a8-0d04-4ed3-abc6-724181e1d5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:18.119975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d467a8-0d04-4ed3-abc6-724181e1d5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:18.121417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d467a8-0d04-4ed3-abc6-724181e1d5f5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:18.124778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adc244-f087-44af-a891-9e9278149aad None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-51d467a8-0d04-4ed3-abc6-724181e1d5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:18.140929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:18.141855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:18.143287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:18.143287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:18.143287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:18.143287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:18.144077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 390/759] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:18.149499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d467a8-0d04-4ed3-abc6-724181e1d5f5 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:18.179901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc11781-593a-4097-8773-295e165cfab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:18.180719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc11781-593a-4097-8773-295e165cfab4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:18.180999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc11781-593a-4097-8773-295e165cfab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:18.181269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc11781-593a-4097-8773-295e165cfab4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:18.195283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc11781-593a-4097-8773-295e165cfab4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:18.196746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc11781-593a-4097-8773-295e165cfab4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-bcc11781-593a-4097-8773-295e165cfab4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:18.218472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:18.221266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:18.223406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:18.223406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:18.223406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:18.223406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:18.223406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:18.223406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:18.223406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:18.223406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:18.223406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 370/760] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:18.235074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc11781-593a-4097-8773-295e165cfab4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:18.255755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d467a8-0d04-4ed3-abc6-724181e1d5f5 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:18.288602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bccefd-7514-4633-9c05-a36d0d35c478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:18.289266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bccefd-7514-4633-9c05-a36d0d35c478 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:18.289541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bccefd-7514-4633-9c05-a36d0d35c478 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:18.289811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bccefd-7514-4633-9c05-a36d0d35c478 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:18.290567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bccefd-7514-4633-9c05-a36d0d35c478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:18.290866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bccefd-7514-4633-9c05-a36d0d35c478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:18.292244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bccefd-7514-4633-9c05-a36d0d35c478 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:18.305225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 391/761] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:18.312178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bccefd-7514-4633-9c05-a36d0d35c478 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:18.370097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc11781-593a-4097-8773-295e165cfab4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:18.413042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c9a53-bd7a-4a55-9883-25ddc22a0c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:18.413705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c9a53-bd7a-4a55-9883-25ddc22a0c43 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:18.413980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c9a53-bd7a-4a55-9883-25ddc22a0c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:18.414271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c9a53-bd7a-4a55-9883-25ddc22a0c43 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:18.415109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c9a53-bd7a-4a55-9883-25ddc22a0c43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:18.415414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c9a53-bd7a-4a55-9883-25ddc22a0c43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:18.416900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c9a53-bd7a-4a55-9883-25ddc22a0c43 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:18.437074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 371/762] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:18.442607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c9a53-bd7a-4a55-9883-25ddc22a0c43 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:18.461162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bccefd-7514-4633-9c05-a36d0d35c478 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:18.495399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd514-b1e9-4811-85e7-1b646882298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:18.496188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd514-b1e9-4811-85e7-1b646882298b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:18.496468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd514-b1e9-4811-85e7-1b646882298b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:18.496736 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd514-b1e9-4811-85e7-1b646882298b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:18.511520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdd514-b1e9-4811-85e7-1b646882298b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:18.512963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdd514-b1e9-4811-85e7-1b646882298b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-d9cdd514-b1e9-4811-85e7-1b646882298b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:18.534983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:18.537181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:18.539329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:18.539329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:18.539329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:18.539329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:18.539329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:18.539329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:18.539329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:18.539329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:18.539329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 392/763] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:18.551266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd514-b1e9-4811-85e7-1b646882298b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:18.614460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c9a53-bd7a-4a55-9883-25ddc22a0c43 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:18.691487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd514-b1e9-4811-85e7-1b646882298b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:18.706752 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33896a3-f95e-46dc-b746-2141471af1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:18.707984 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33896a3-f95e-46dc-b746-2141471af1bf None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:18.708467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33896a3-f95e-46dc-b746-2141471af1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:18.708960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33896a3-f95e-46dc-b746-2141471af1bf None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/dc19a5d9ce774f39aa49ab7c64ba682e/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:18.715329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33896a3-f95e-46dc-b746-2141471af1bf None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=dc19a5d9ce774f39aa49ab7c64ba682e, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:18.717005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33896a3-f95e-46dc-b746-2141471af1bf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:18.725346 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a8618-3894-4b29-a054-9510cb7fcc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:18.726032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a8618-3894-4b29-a054-9510cb7fcc0c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:18.726341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a8618-3894-4b29-a054-9510cb7fcc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:18.726614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a8618-3894-4b29-a054-9510cb7fcc0c None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:18.727425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a8618-3894-4b29-a054-9510cb7fcc0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:18.727727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a8618-3894-4b29-a054-9510cb7fcc0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:18.729207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a8618-3894-4b29-a054-9510cb7fcc0c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:18.743190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 393/764] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:18.749168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a8618-3894-4b29-a054-9510cb7fcc0c None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:18.806811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 372/765] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:18 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/dc19a5d9ce774f39aa49ab7c64ba682e/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:56:18.852009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a8618-3894-4b29-a054-9510cb7fcc0c None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:18.891560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2d827-74dc-4ce0-a5e7-a29d46ae780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:18.892912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2d827-74dc-4ce0-a5e7-a29d46ae780c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:18.893265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2d827-74dc-4ce0-a5e7-a29d46ae780c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:18.893610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2d827-74dc-4ce0-a5e7-a29d46ae780c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:18.894554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2d827-74dc-4ce0-a5e7-a29d46ae780c None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=8f9bad450f474e5a835d7c70b210e60e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:18.894937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2d827-74dc-4ce0-a5e7-a29d46ae780c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:18.896463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2d827-74dc-4ce0-a5e7-a29d46ae780c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:18.903465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 394/766] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:18 2022] GET /identity/v3/role_assignments?user.id=8f9bad450f474e5a835d7c70b210e60e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:19.114756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad321d-aeab-4817-93ba-8df9b35022f8 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:19.115321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad321d-aeab-4817-93ba-8df9b35022f8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:19.115746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad321d-aeab-4817-93ba-8df9b35022f8 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:19.117553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 373/767] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:19.124816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d318d-3bd7-4031-864d-1685dc5369a8 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:19.125739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d318d-3bd7-4031-864d-1685dc5369a8 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:19.126225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d318d-3bd7-4031-864d-1685dc5369a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:19.144323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-bf7d318d-3bd7-4031-864d-1685dc5369a8 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:19.145793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bf7d318d-3bd7-4031-864d-1685dc5369a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:19.222161 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 395/768] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:19.239512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad321d-aeab-4817-93ba-8df9b35022f8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:19.350029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad321d-aeab-4817-93ba-8df9b35022f8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:19.384863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f70b3-d6d8-45d2-94ea-7fd8129956c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:19.385980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f70b3-d6d8-45d2-94ea-7fd8129956c6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:19.386475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f70b3-d6d8-45d2-94ea-7fd8129956c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:19.386962 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f70b3-d6d8-45d2-94ea-7fd8129956c6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:19.387817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f70b3-d6d8-45d2-94ea-7fd8129956c6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:19.389371 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f70b3-d6d8-45d2-94ea-7fd8129956c6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-cb9f70b3-d6d8-45d2-94ea-7fd8129956c6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:19.402848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:19.403832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:56:19.404685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:19.410163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 374/769] 10.222.0.44 () {56 vars in 1129 bytes} [Mon May 16 14:56:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:19.414275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d318d-3bd7-4031-864d-1685dc5369a8 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:19.462296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc90d-17b5-4d74-8602-25737fdb3960 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:19.463061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc90d-17b5-4d74-8602-25737fdb3960 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:19.463483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc90d-17b5-4d74-8602-25737fdb3960 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:19.465285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 375/770] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:19.479576 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f220073-9b62-4570-a92b-bb171fb4c0a1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:19.480083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f220073-9b62-4570-a92b-bb171fb4c0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:19.480505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f220073-9b62-4570-a92b-bb171fb4c0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:19.504126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6f220073-9b62-4570-a92b-bb171fb4c0a1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:19.506890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6f220073-9b62-4570-a92b-bb171fb4c0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:19.577089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d318d-3bd7-4031-864d-1685dc5369a8 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:19.604245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 376/771] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:19.627749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b36a-f10d-40f1-83b6-ba213b22265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:19.628663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b36a-f10d-40f1-83b6-ba213b22265c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:19.629115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b36a-f10d-40f1-83b6-ba213b22265c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:19.629532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b36a-f10d-40f1-83b6-ba213b22265c None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:19.630505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b36a-f10d-40f1-83b6-ba213b22265c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:19.630968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b36a-f10d-40f1-83b6-ba213b22265c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:19.632475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b36a-f10d-40f1-83b6-ba213b22265c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:19.641476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 396/772] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 16 14:56:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:19.642776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f220073-9b62-4570-a92b-bb171fb4c0a1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:19.654384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b36a-f10d-40f1-83b6-ba213b22265c None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:19.781004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b36a-f10d-40f1-83b6-ba213b22265c None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:19.810747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f220073-9b62-4570-a92b-bb171fb4c0a1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:19.857591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a5c0-2950-4e1b-bb23-1574449ff899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:19.858206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a5c0-2950-4e1b-bb23-1574449ff899 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:19.858497 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a5c0-2950-4e1b-bb23-1574449ff899 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:19.858763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a5c0-2950-4e1b-bb23-1574449ff899 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:19.859482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a5c0-2950-4e1b-bb23-1574449ff899 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:19.859785 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a5c0-2950-4e1b-bb23-1574449ff899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:19.861781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a5c0-2950-4e1b-bb23-1574449ff899 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:19.874608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 397/773] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 16 14:56:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:19.880749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a5c0-2950-4e1b-bb23-1574449ff899 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:19.885245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17506-33d0-494c-adbf-5786b0e2f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:19.886064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17506-33d0-494c-adbf-5786b0e2f8ef None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:19.886356 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17506-33d0-494c-adbf-5786b0e2f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:19.886628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17506-33d0-494c-adbf-5786b0e2f8ef None admin] PATH_INFO: `/v3/services/network` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:19.888229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e17506-33d0-494c-adbf-5786b0e2f8ef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:19.889613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e17506-33d0-494c-adbf-5786b0e2f8ef None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-10e17506-33d0-494c-adbf-5786b0e2f8ef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:19.909543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:19.910593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:56:19.911424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:19.920661 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 377/774] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:19 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:19.923230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17506-33d0-494c-adbf-5786b0e2f8ef None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:20.036091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17506-33d0-494c-adbf-5786b0e2f8ef None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:20.070579 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbb886-5697-401e-ba80-bbb2f9b6549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:20.071646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbb886-5697-401e-ba80-bbb2f9b6549a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.072132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbb886-5697-401e-ba80-bbb2f9b6549a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.072623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbb886-5697-401e-ba80-bbb2f9b6549a None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.073530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbb886-5697-401e-ba80-bbb2f9b6549a None admin] RBAC: Adding query filter params (name=network) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:20.074039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbb886-5697-401e-ba80-bbb2f9b6549a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:20.079777 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbb886-5697-401e-ba80-bbb2f9b6549a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:20.090003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 378/775] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:20.090003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348af85-4561-493c-9bdb-c785bff7f277 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.090003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348af85-4561-493c-9bdb-c785bff7f277 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.090003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348af85-4561-493c-9bdb-c785bff7f277 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.093767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 379/776] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:20.094917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348af85-4561-493c-9bdb-c785bff7f277 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:20.096579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a5c0-2950-4e1b-bb23-1574449ff899 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:20.136958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de740af-7e01-464f-93cf-c29b31aa3096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:20.139158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de740af-7e01-464f-93cf-c29b31aa3096 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.139616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de740af-7e01-464f-93cf-c29b31aa3096 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.140039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de740af-7e01-464f-93cf-c29b31aa3096 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.140992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de740af-7e01-464f-93cf-c29b31aa3096 None admin] RBAC: Adding query filter params (interface=public, service_id=b1afed546ae54d14ba88dbcef200939f, region_id=RegionOne) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:20.141453 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de740af-7e01-464f-93cf-c29b31aa3096 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:20.143104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de740af-7e01-464f-93cf-c29b31aa3096 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:20.152761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 398/777] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 16 14:56:19 2022] GET /identity/v3/endpoints?service_id=b1afed546ae54d14ba88dbcef200939f&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:20.154294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07f87-13ae-4a5c-9e48-0b2b43f0c8ff None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.154745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07f87-13ae-4a5c-9e48-0b2b43f0c8ff None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.155151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf07f87-13ae-4a5c-9e48-0b2b43f0c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.174333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9bf07f87-13ae-4a5c-9e48-0b2b43f0c8ff None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:20.175689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9bf07f87-13ae-4a5c-9e48-0b2b43f0c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:20.218823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348af85-4561-493c-9bdb-c785bff7f277 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:20.243820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 399/778] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:20.245027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf07f87-13ae-4a5c-9e48-0b2b43f0c8ff None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:20.265837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb5dde-f673-4a23-951c-883e1dda90df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:20.266556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb5dde-f673-4a23-951c-883e1dda90df None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.266841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb5dde-f673-4a23-951c-883e1dda90df None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.267679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb5dde-f673-4a23-951c-883e1dda90df None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.268430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb5dde-f673-4a23-951c-883e1dda90df None admin] RBAC: Adding query filter params (type=network) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:20.268790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb5dde-f673-4a23-951c-883e1dda90df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:20.270216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb5dde-f673-4a23-951c-883e1dda90df None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:20.286143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 380/779] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:20.287544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb5dde-f673-4a23-951c-883e1dda90df None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:20.350094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf07f87-13ae-4a5c-9e48-0b2b43f0c8ff None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:20.387305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cac8c3-d007-43ba-bb91-a87eed070834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:20.387889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cac8c3-d007-43ba-bb91-a87eed070834 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.388167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cac8c3-d007-43ba-bb91-a87eed070834 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.388440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cac8c3-d007-43ba-bb91-a87eed070834 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.389122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cac8c3-d007-43ba-bb91-a87eed070834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:20.390538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cac8c3-d007-43ba-bb91-a87eed070834 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:20.391422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb5dde-f673-4a23-951c-883e1dda90df None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:20.395990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 400/780] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 16 14:56:20 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:20.396861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cac8c3-d007-43ba-bb91-a87eed070834 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:20.488721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6d4d-df03-4aa3-9a61-132257a8779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:20.489533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6d4d-df03-4aa3-9a61-132257a8779d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.489816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6d4d-df03-4aa3-9a61-132257a8779d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.490109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6d4d-df03-4aa3-9a61-132257a8779d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.501392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cac8c3-d007-43ba-bb91-a87eed070834 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:20.523150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef6d4d-df03-4aa3-9a61-132257a8779d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-bcef6d4d-df03-4aa3-9a61-132257a8779d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:20.539602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:20.540623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:20.541461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:20.542163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 381/781] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:20.544026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5dd5a-feb9-4f3e-a701-65541a3029e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:20.544704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5dd5a-feb9-4f3e-a701-65541a3029e3 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.544984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5dd5a-feb9-4f3e-a701-65541a3029e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.545305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5dd5a-feb9-4f3e-a701-65541a3029e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.546153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5dd5a-feb9-4f3e-a701-65541a3029e3 None admin] RBAC: Adding query filter params (interface=public, service_id=f0cd12773aef42549cf36c91545db2f2, region_id=RegionOne) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:20.547444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6d4d-df03-4aa3-9a61-132257a8779d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:20.547864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5dd5a-feb9-4f3e-a701-65541a3029e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:20.554663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5dd5a-feb9-4f3e-a701-65541a3029e3 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:20.564642 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 401/782] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 16 14:56:20 2022] GET /identity/v3/endpoints?service_id=f0cd12773aef42549cf36c91545db2f2&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:20.583618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5dd5a-feb9-4f3e-a701-65541a3029e3 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:20.659629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6d4d-df03-4aa3-9a61-132257a8779d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:20.701253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36832ba-0093-4e81-9548-f614a8765381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:20.702241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36832ba-0093-4e81-9548-f614a8765381 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.702527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36832ba-0093-4e81-9548-f614a8765381 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.702800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36832ba-0093-4e81-9548-f614a8765381 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.704034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36832ba-0093-4e81-9548-f614a8765381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:20.704348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36832ba-0093-4e81-9548-f614a8765381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:20.706725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36832ba-0093-4e81-9548-f614a8765381 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:20.718758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 382/783] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:20.728030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36832ba-0093-4e81-9548-f614a8765381 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:20.753375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5dd5a-feb9-4f3e-a701-65541a3029e3 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:20.793209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03139f0-7705-4e84-9632-a9493ba86485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:20.794617 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03139f0-7705-4e84-9632-a9493ba86485 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.795051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03139f0-7705-4e84-9632-a9493ba86485 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.795756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03139f0-7705-4e84-9632-a9493ba86485 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.796755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03139f0-7705-4e84-9632-a9493ba86485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:20.798976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03139f0-7705-4e84-9632-a9493ba86485 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:20.806763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 402/784] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 16 14:56:20 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:20.839941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36832ba-0093-4e81-9548-f614a8765381 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:20.877061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d666e6c-c408-415f-802e-4d54c2cb900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:20.877877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d666e6c-c408-415f-802e-4d54c2cb900a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:20.878196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d666e6c-c408-415f-802e-4d54c2cb900a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:20.878472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d666e6c-c408-415f-802e-4d54c2cb900a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:20.890300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d666e6c-c408-415f-802e-4d54c2cb900a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:20.891798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d666e6c-c408-415f-802e-4d54c2cb900a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-1d666e6c-c408-415f-802e-4d54c2cb900a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:20.911592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:20.912511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:20.913392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:20.913392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:20.913392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:20.913392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:20.913392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 383/785] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:20.920012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03139f0-7705-4e84-9632-a9493ba86485 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:21.074481 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03139f0-7705-4e84-9632-a9493ba86485 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:21.121084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05c7a5-045a-4cfb-a3a1-697b28d0873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:21.121750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c7a5-045a-4cfb-a3a1-697b28d0873f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.122028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c7a5-045a-4cfb-a3a1-697b28d0873f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.122357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05c7a5-045a-4cfb-a3a1-697b28d0873f None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.123076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05c7a5-045a-4cfb-a3a1-697b28d0873f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:21.123377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05c7a5-045a-4cfb-a3a1-697b28d0873f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:21.124734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05c7a5-045a-4cfb-a3a1-697b28d0873f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:21.139872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 403/786] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:21.145511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d666e6c-c408-415f-802e-4d54c2cb900a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:21.267231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d666e6c-c408-415f-802e-4d54c2cb900a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:21.306644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef32ac7-169d-410d-892c-c46ffb1e3471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:21.307818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef32ac7-169d-410d-892c-c46ffb1e3471 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.308322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef32ac7-169d-410d-892c-c46ffb1e3471 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.308794 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef32ac7-169d-410d-892c-c46ffb1e3471 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.317637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef32ac7-169d-410d-892c-c46ffb1e3471 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:21.319364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef32ac7-169d-410d-892c-c46ffb1e3471 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-4ef32ac7-169d-410d-892c-c46ffb1e3471 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:21.334674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:21.335676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:21.336718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:21.339794 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 384/787] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:21.345082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05c7a5-045a-4cfb-a3a1-697b28d0873f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:21.441095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13341cd-426b-4f9a-adc4-e9af261aefff None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.441731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13341cd-426b-4f9a-adc4-e9af261aefff None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.442301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13341cd-426b-4f9a-adc4-e9af261aefff None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.447451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 385/788] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:21.451349 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eae4d-1bc6-4159-833a-1da38d9d1ef0 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.451856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eae4d-1bc6-4159-833a-1da38d9d1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.452347 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eae4d-1bc6-4159-833a-1da38d9d1ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.461090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05c7a5-045a-4cfb-a3a1-697b28d0873f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:21.478011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-928eae4d-1bc6-4159-833a-1da38d9d1ef0 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:21.483618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-928eae4d-1bc6-4159-833a-1da38d9d1ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:21.498087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b0493-41f3-4265-bea7-f5e7f36e8fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:21.498087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b0493-41f3-4265-bea7-f5e7f36e8fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.498087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b0493-41f3-4265-bea7-f5e7f36e8fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.498087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b0493-41f3-4265-bea7-f5e7f36e8fa4 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.498537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b0493-41f3-4265-bea7-f5e7f36e8fa4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:21.498809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b0493-41f3-4265-bea7-f5e7f36e8fa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:21.500289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b0493-41f3-4265-bea7-f5e7f36e8fa4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:21.522998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 404/789] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 16 14:56:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:21.529176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b0493-41f3-4265-bea7-f5e7f36e8fa4 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:21.637231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b0493-41f3-4265-bea7-f5e7f36e8fa4 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:21.667725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 386/790] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:21.673813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98c3b3-8851-44d2-9677-f263a3ce2b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:21.674624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98c3b3-8851-44d2-9677-f263a3ce2b97 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.674905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98c3b3-8851-44d2-9677-f263a3ce2b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.675181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98c3b3-8851-44d2-9677-f263a3ce2b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.685184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98c3b3-8851-44d2-9677-f263a3ce2b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:21.686675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98c3b3-8851-44d2-9677-f263a3ce2b97 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-ff98c3b3-8851-44d2-9677-f263a3ce2b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:21.704258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:21.705767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:21.707094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:21.707094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:21.707094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:21.707094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:21.707094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 405/791] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:21.712060 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eae4d-1bc6-4159-833a-1da38d9d1ef0 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:21.734960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98c3b3-8851-44d2-9677-f263a3ce2b97 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:21.828463 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eae4d-1bc6-4159-833a-1da38d9d1ef0 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:21.860245 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98c3b3-8851-44d2-9677-f263a3ce2b97 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:21.863001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483263-ae15-4413-a7a1-6d4b3002f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:21.863873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483263-ae15-4413-a7a1-6d4b3002f238 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.864148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483263-ae15-4413-a7a1-6d4b3002f238 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.864417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483263-ae15-4413-a7a1-6d4b3002f238 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.865130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483263-ae15-4413-a7a1-6d4b3002f238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:21.865429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483263-ae15-4413-a7a1-6d4b3002f238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:21.866839 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483263-ae15-4413-a7a1-6d4b3002f238 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:21.878935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 387/792] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:21.880361 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bb974-5cc6-4b23-a060-b5ca89f60d4a None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.880657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bb974-5cc6-4b23-a060-b5ca89f60d4a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.880928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bb974-5cc6-4b23-a060-b5ca89f60d4a None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.886482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 388/793] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:21.887217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bb974-5cc6-4b23-a060-b5ca89f60d4a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:21.904889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9e713-494e-4a3b-b457-20ad24b0db1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:21.905855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e713-494e-4a3b-b457-20ad24b0db1c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.906456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e713-494e-4a3b-b457-20ad24b0db1c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.906788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e713-494e-4a3b-b457-20ad24b0db1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.922730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9e713-494e-4a3b-b457-20ad24b0db1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-f1c9e713-494e-4a3b-b457-20ad24b0db1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:21.933283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:21.935517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 406/794] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:21.937511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e228a-754e-4c65-8b3a-4d27d37e9aea None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:21.944723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e228a-754e-4c65-8b3a-4d27d37e9aea None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:21.944723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e228a-754e-4c65-8b3a-4d27d37e9aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:21.956738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-b38e228a-754e-4c65-8b3a-4d27d37e9aea None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:21.957934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b38e228a-754e-4c65-8b3a-4d27d37e9aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:22.006294 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bb974-5cc6-4b23-a060-b5ca89f60d4a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.038928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a296d-d873-411a-932b-56991da65bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.040292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a296d-d873-411a-932b-56991da65bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.040583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a296d-d873-411a-932b-56991da65bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.040863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a296d-d873-411a-932b-56991da65bd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.048025 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a296d-d873-411a-932b-56991da65bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:22.050081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a296d-d873-411a-932b-56991da65bd4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:22.050371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 407/795] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:22.051256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e228a-754e-4c65-8b3a-4d27d37e9aea None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-512a296d-d873-411a-932b-56991da65bd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:22.068645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:22.070788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:22.073017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:22.073017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:22.073017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:22.073017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:22.073017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:22.073017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:22.073017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:22.073017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:22.073017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 389/796] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:22.084921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a296d-d873-411a-932b-56991da65bd4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.160550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e228a-754e-4c65-8b3a-4d27d37e9aea None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.174323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a296d-d873-411a-932b-56991da65bd4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.197197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df53b15-d11c-484e-869f-b420375da7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.198353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df53b15-d11c-484e-869f-b420375da7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.198902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df53b15-d11c-484e-869f-b420375da7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.199372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df53b15-d11c-484e-869f-b420375da7b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.200483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df53b15-d11c-484e-869f-b420375da7b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:22.200994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df53b15-d11c-484e-869f-b420375da7b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:22.202643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df53b15-d11c-484e-869f-b420375da7b1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:22.210630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e141f5-8baa-4fe3-b849-26f0a3373ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.211528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e141f5-8baa-4fe3-b849-26f0a3373ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.216289 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e141f5-8baa-4fe3-b849-26f0a3373ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.216289 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e141f5-8baa-4fe3-b849-26f0a3373ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.216912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 408/797] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:56:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:22.217963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df53b15-d11c-484e-869f-b420375da7b1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.223598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e141f5-8baa-4fe3-b849-26f0a3373ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f4e141f5-8baa-4fe3-b849-26f0a3373ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:22.231232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:22.232306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:22.233135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 390/798] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:22.233822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e141f5-8baa-4fe3-b849-26f0a3373ec8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.322707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df53b15-d11c-484e-869f-b420375da7b1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.340121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e141f5-8baa-4fe3-b849-26f0a3373ec8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.358940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554915c8-8bb7-4561-8d8f-e8f5ce8ec9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.359900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554915c8-8bb7-4561-8d8f-e8f5ce8ec9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.360404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554915c8-8bb7-4561-8d8f-e8f5ce8ec9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.360904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554915c8-8bb7-4561-8d8f-e8f5ce8ec9d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.361874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554915c8-8bb7-4561-8d8f-e8f5ce8ec9d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:22.362410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554915c8-8bb7-4561-8d8f-e8f5ce8ec9d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:22.364027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554915c8-8bb7-4561-8d8f-e8f5ce8ec9d5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:22.374107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b8f5-5bfe-406b-b696-267dc2b5ff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.374904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b8f5-5bfe-406b-b696-267dc2b5ff6b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.375190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b8f5-5bfe-406b-b696-267dc2b5ff6b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.375464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b8f5-5bfe-406b-b696-267dc2b5ff6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.377435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 409/799] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:22.378444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554915c8-8bb7-4561-8d8f-e8f5ce8ec9d5 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.392995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b8f5-5bfe-406b-b696-267dc2b5ff6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:22.395485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b8f5-5bfe-406b-b696-267dc2b5ff6b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0fc7b8f5-5bfe-406b-b696-267dc2b5ff6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:22.418182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:22.419118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:22.419998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:22.419998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:22.419998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:22.419998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:22.424112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 391/800] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:22.424931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b8f5-5bfe-406b-b696-267dc2b5ff6b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.508008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554915c8-8bb7-4561-8d8f-e8f5ce8ec9d5 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.526641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b8f5-5bfe-406b-b696-267dc2b5ff6b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.547607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e44067-2bdf-497a-870a-5099d5990ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.548303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e44067-2bdf-497a-870a-5099d5990ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.549082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e44067-2bdf-497a-870a-5099d5990ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.549356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e44067-2bdf-497a-870a-5099d5990ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.550126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e44067-2bdf-497a-870a-5099d5990ee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:22.550438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e44067-2bdf-497a-870a-5099d5990ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:22.551862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e44067-2bdf-497a-870a-5099d5990ee8 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:22.562410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 410/801] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:22.563478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e44067-2bdf-497a-870a-5099d5990ee8 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.569249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a142d-e7e5-4f11-9fbe-0e2f2cd69048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.570479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a142d-e7e5-4f11-9fbe-0e2f2cd69048 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.570959 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a142d-e7e5-4f11-9fbe-0e2f2cd69048 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.571428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a142d-e7e5-4f11-9fbe-0e2f2cd69048 None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/6a6668cb0bda4d61b6b96f547a422830/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.573641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a142d-e7e5-4f11-9fbe-0e2f2cd69048 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=6a6668cb0bda4d61b6b96f547a422830, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:22.576480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a142d-e7e5-4f11-9fbe-0e2f2cd69048 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:22.646302 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 392/802] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:22 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/6a6668cb0bda4d61b6b96f547a422830/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:56:22.647300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a142d-e7e5-4f11-9fbe-0e2f2cd69048 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.678431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e44067-2bdf-497a-870a-5099d5990ee8 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.719740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddd651-0ea8-4bdd-ab63-04711eefd6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.721370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddd651-0ea8-4bdd-ab63-04711eefd6bd None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.721852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddd651-0ea8-4bdd-ab63-04711eefd6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.722487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddd651-0ea8-4bdd-ab63-04711eefd6bd None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.723420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddd651-0ea8-4bdd-ab63-04711eefd6bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:22.723934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddd651-0ea8-4bdd-ab63-04711eefd6bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:22.725841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddd651-0ea8-4bdd-ab63-04711eefd6bd None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:22.741488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 411/803] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:22.747998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddd651-0ea8-4bdd-ab63-04711eefd6bd None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.863351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddd651-0ea8-4bdd-ab63-04711eefd6bd None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.904527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6c2b5-b837-4d7e-ad20-ce0ba85f27ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.905746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6c2b5-b837-4d7e-ad20-ce0ba85f27ea None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.906254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6c2b5-b837-4d7e-ad20-ce0ba85f27ea None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.906749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6c2b5-b837-4d7e-ad20-ce0ba85f27ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.916220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6c2b5-b837-4d7e-ad20-ce0ba85f27ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:22.916413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a142d-e7e5-4f11-9fbe-0e2f2cd69048 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:22.918369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6c2b5-b837-4d7e-ad20-ce0ba85f27ea None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-65a6c2b5-b837-4d7e-ad20-ce0ba85f27ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:22.937429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:22.938471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:22.939972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:22.943683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 412/804] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:56:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:22.949613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6c2b5-b837-4d7e-ad20-ce0ba85f27ea None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:22.974570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c708cc-e12b-4210-960c-ac788c70f242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:22.975421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c708cc-e12b-4210-960c-ac788c70f242 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:22.975648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c708cc-e12b-4210-960c-ac788c70f242 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:22.975914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c708cc-e12b-4210-960c-ac788c70f242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:22.992439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c708cc-e12b-4210-960c-ac788c70f242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:22.993679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c708cc-e12b-4210-960c-ac788c70f242 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-d2c708cc-e12b-4210-960c-ac788c70f242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:23.019645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:23.020598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:23.021485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:23.021485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:23.021485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:23.021485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:23.021485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 393/805] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:23.030102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c708cc-e12b-4210-960c-ac788c70f242 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:23.077438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6c2b5-b837-4d7e-ad20-ce0ba85f27ea None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:23.123834 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4370d-2d04-426a-8eb3-b437805a8443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:23.124407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4370d-2d04-426a-8eb3-b437805a8443 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.124689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4370d-2d04-426a-8eb3-b437805a8443 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.124964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4370d-2d04-426a-8eb3-b437805a8443 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.125856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4370d-2d04-426a-8eb3-b437805a8443 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:23.126127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4370d-2d04-426a-8eb3-b437805a8443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:23.127595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4370d-2d04-426a-8eb3-b437805a8443 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.161312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 413/806] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 16 14:56:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:23.162888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e279-e75c-4417-84fa-5d861dd505dd None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.163178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e279-e75c-4417-84fa-5d861dd505dd None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.163454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e279-e75c-4417-84fa-5d861dd505dd None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.165212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 414/807] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:23.166040 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2e279-e75c-4417-84fa-5d861dd505dd None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:23.200662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c708cc-e12b-4210-960c-ac788c70f242 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:23.243736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285e6bf-03a2-42ba-b3a4-156c30f6cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:23.244699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285e6bf-03a2-42ba-b3a4-156c30f6cfba None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.245157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285e6bf-03a2-42ba-b3a4-156c30f6cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.245708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285e6bf-03a2-42ba-b3a4-156c30f6cfba None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.246644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285e6bf-03a2-42ba-b3a4-156c30f6cfba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:23.247530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285e6bf-03a2-42ba-b3a4-156c30f6cfba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:23.249427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285e6bf-03a2-42ba-b3a4-156c30f6cfba None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.273725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2e279-e75c-4417-84fa-5d861dd505dd None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:23.312204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73415640-301c-4284-885a-5ac101c56e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:23.313126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415640-301c-4284-885a-5ac101c56e6a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.313474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415640-301c-4284-885a-5ac101c56e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.313763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73415640-301c-4284-885a-5ac101c56e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.329017 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73415640-301c-4284-885a-5ac101c56e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:23.331080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73415640-301c-4284-885a-5ac101c56e6a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-73415640-301c-4284-885a-5ac101c56e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:23.351081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:23.352045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:23.352958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:23.352958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:23.352958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:23.352958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:23.352958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 415/808] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:23.354165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd567b-a410-43d4-8495-295053d03763 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.354448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd567b-a410-43d4-8495-295053d03763 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.354719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd567b-a410-43d4-8495-295053d03763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.373048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-12dd567b-a410-43d4-8495-295053d03763 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:23.374493 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-12dd567b-a410-43d4-8495-295053d03763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:23.401339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 394/809] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:23.402714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adaa2f-0108-4987-adf5-d4e893293d1c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.402988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adaa2f-0108-4987-adf5-d4e893293d1c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.403263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adaa2f-0108-4987-adf5-d4e893293d1c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.404610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 395/810] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:23.409177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adaa2f-0108-4987-adf5-d4e893293d1c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:23.445545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 416/811] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:23.446078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd567b-a410-43d4-8495-295053d03763 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:23.515164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adaa2f-0108-4987-adf5-d4e893293d1c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:23.541769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd567b-a410-43d4-8495-295053d03763 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:23.546941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387f6e2-0534-486c-aa65-5e1077053c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:23.547600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f6e2-0534-486c-aa65-5e1077053c7e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.547879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f6e2-0534-486c-aa65-5e1077053c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.548148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f6e2-0534-486c-aa65-5e1077053c7e None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.548934 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387f6e2-0534-486c-aa65-5e1077053c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:23.549236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387f6e2-0534-486c-aa65-5e1077053c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:23.550634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387f6e2-0534-486c-aa65-5e1077053c7e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.566450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 396/812] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:23.566450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774ded-0f14-4443-9dfc-2c67d70f6bfc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.566450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774ded-0f14-4443-9dfc-2c67d70f6bfc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.566450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774ded-0f14-4443-9dfc-2c67d70f6bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.581818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-89774ded-0f14-4443-9dfc-2c67d70f6bfc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:23.582130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d865be-cf4b-4cd3-82e4-5bab0b35a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:23.582914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d865be-cf4b-4cd3-82e4-5bab0b35a58e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.583097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-89774ded-0f14-4443-9dfc-2c67d70f6bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:23.583212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d865be-cf4b-4cd3-82e4-5bab0b35a58e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.583460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d865be-cf4b-4cd3-82e4-5bab0b35a58e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.591437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d865be-cf4b-4cd3-82e4-5bab0b35a58e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:23.592871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d865be-cf4b-4cd3-82e4-5bab0b35a58e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-d5d865be-cf4b-4cd3-82e4-5bab0b35a58e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:23.607777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:23.608925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 417/813] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:23.609890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d865be-cf4b-4cd3-82e4-5bab0b35a58e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:23.654118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 397/814] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:23.654962 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89774ded-0f14-4443-9dfc-2c67d70f6bfc None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:23.725999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d865be-cf4b-4cd3-82e4-5bab0b35a58e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:23.750215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89774ded-0f14-4443-9dfc-2c67d70f6bfc None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:23.763439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db259570-3027-42d6-b059-ebe90cb96777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:23.764483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db259570-3027-42d6-b059-ebe90cb96777 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.764766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db259570-3027-42d6-b059-ebe90cb96777 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.765086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db259570-3027-42d6-b059-ebe90cb96777 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.765745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db259570-3027-42d6-b059-ebe90cb96777 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:23.768557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db259570-3027-42d6-b059-ebe90cb96777 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-db259570-3027-42d6-b059-ebe90cb96777 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:23.780650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:23.781578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:23.782487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 418/815] 10.222.0.44 () {56 vars in 1129 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:23.783405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db259570-3027-42d6-b059-ebe90cb96777 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:23.789285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5926b7-e2fc-4cdd-a33b-a4e423d5e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:23.790102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5926b7-e2fc-4cdd-a33b-a4e423d5e7fb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.790391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5926b7-e2fc-4cdd-a33b-a4e423d5e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.790663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5926b7-e2fc-4cdd-a33b-a4e423d5e7fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.798257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5926b7-e2fc-4cdd-a33b-a4e423d5e7fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:23.800185 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5926b7-e2fc-4cdd-a33b-a4e423d5e7fb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ef5926b7-e2fc-4cdd-a33b-a4e423d5e7fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:23.813508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:23.814988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:23.815911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:23.815911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:23.815911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:23.815911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:23.815911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:23.815911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:23.815911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:23.815911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:23.815911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 398/816] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:23.816403 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5926b7-e2fc-4cdd-a33b-a4e423d5e7fb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:23.883549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db259570-3027-42d6-b059-ebe90cb96777 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:23.918975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3589-eb15-454c-93bb-011bf0f25a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:23.919649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3589-eb15-454c-93bb-011bf0f25a6b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.919936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3589-eb15-454c-93bb-011bf0f25a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.920209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3589-eb15-454c-93bb-011bf0f25a6b None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.921048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c3589-eb15-454c-93bb-011bf0f25a6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:23.921358 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c3589-eb15-454c-93bb-011bf0f25a6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:23.922864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c3589-eb15-454c-93bb-011bf0f25a6b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.931737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5926b7-e2fc-4cdd-a33b-a4e423d5e7fb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:23.940140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 419/817] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:23.940961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3589-eb15-454c-93bb-011bf0f25a6b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:23.970801 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91699ced-71a6-4dbb-aced-a0b38143e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:23.971586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91699ced-71a6-4dbb-aced-a0b38143e6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:23.971867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91699ced-71a6-4dbb-aced-a0b38143e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:23.972140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91699ced-71a6-4dbb-aced-a0b38143e6b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:23.972785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91699ced-71a6-4dbb-aced-a0b38143e6b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:23.974164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91699ced-71a6-4dbb-aced-a0b38143e6b7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-91699ced-71a6-4dbb-aced-a0b38143e6b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:23.986488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:23.987602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 14:56:23.988512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:23.993088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 399/818] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:23.993750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91699ced-71a6-4dbb-aced-a0b38143e6b7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.039976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3589-eb15-454c-93bb-011bf0f25a6b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:24.073563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f5589-050f-41d3-b8bb-a5354924b181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:24.074268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f5589-050f-41d3-b8bb-a5354924b181 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:24.074551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f5589-050f-41d3-b8bb-a5354924b181 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:24.074830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f5589-050f-41d3-b8bb-a5354924b181 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:24.077920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f5589-050f-41d3-b8bb-a5354924b181 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:24.077920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f5589-050f-41d3-b8bb-a5354924b181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:24.077920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f5589-050f-41d3-b8bb-a5354924b181 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:24.086529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 420/819] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:24.086529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f5589-050f-41d3-b8bb-a5354924b181 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.108857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91699ced-71a6-4dbb-aced-a0b38143e6b7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:24.142709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707de506-b492-4910-9274-833177143dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:24.143382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707de506-b492-4910-9274-833177143dce None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:24.143657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707de506-b492-4910-9274-833177143dce None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:24.143929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707de506-b492-4910-9274-833177143dce None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:24.144829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707de506-b492-4910-9274-833177143dce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:24.145014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707de506-b492-4910-9274-833177143dce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:24.146476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707de506-b492-4910-9274-833177143dce None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:24.158898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 400/820] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:24.159522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707de506-b492-4910-9274-833177143dce None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.187760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f5589-050f-41d3-b8bb-a5354924b181 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:24.221262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa82c7-d2ab-4051-85a4-4dd5cee7d9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:24.222062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa82c7-d2ab-4051-85a4-4dd5cee7d9ee None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:24.222373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa82c7-d2ab-4051-85a4-4dd5cee7d9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:24.222644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa82c7-d2ab-4051-85a4-4dd5cee7d9ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:24.258375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707de506-b492-4910-9274-833177143dce None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:24.286856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa82c7-d2ab-4051-85a4-4dd5cee7d9ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:24.288297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa82c7-d2ab-4051-85a4-4dd5cee7d9ee None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:24.290773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c11d-ce1a-4add-b5bd-510cabe2619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:24.291429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c11d-ce1a-4add-b5bd-510cabe2619b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:24.291705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c11d-ce1a-4add-b5bd-510cabe2619b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:24.291976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c11d-ce1a-4add-b5bd-510cabe2619b None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:24.292666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35c11d-ce1a-4add-b5bd-510cabe2619b None admin] RBAC: Adding query filter params (name=network) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:24.292965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35c11d-ce1a-4add-b5bd-510cabe2619b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:24.294335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35c11d-ce1a-4add-b5bd-510cabe2619b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:24.299515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 401/821] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:24.300565 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c11d-ce1a-4add-b5bd-510cabe2619b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.387320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 421/822] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:56:24.388127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa82c7-d2ab-4051-85a4-4dd5cee7d9ee None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.402418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c11d-ce1a-4add-b5bd-510cabe2619b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:24.435759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31387bfc-e70c-4b19-8c45-6ec3142965c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:24.436523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31387bfc-e70c-4b19-8c45-6ec3142965c0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:24.436878 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31387bfc-e70c-4b19-8c45-6ec3142965c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:24.437159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31387bfc-e70c-4b19-8c45-6ec3142965c0 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:24.437862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31387bfc-e70c-4b19-8c45-6ec3142965c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:24.438194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31387bfc-e70c-4b19-8c45-6ec3142965c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:24.439592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31387bfc-e70c-4b19-8c45-6ec3142965c0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:24.448541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 402/823] 10.222.0.44 () {56 vars in 1124 bytes} [Mon May 16 14:56:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:24.448541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31387bfc-e70c-4b19-8c45-6ec3142965c0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.489850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa82c7-d2ab-4051-85a4-4dd5cee7d9ee None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:24.522122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27852-d517-4652-8269-5db98fd2a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:24.523317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27852-d517-4652-8269-5db98fd2a9c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:24.523601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27852-d517-4652-8269-5db98fd2a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:24.523874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e27852-d517-4652-8269-5db98fd2a9c3 None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/8f9bad450f474e5a835d7c70b210e60e/roles/4235f90e4db94284adec59aa60035bf6` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:24.538363 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e27852-d517-4652-8269-5db98fd2a9c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=8f9bad450f474e5a835d7c70b210e60e, role_id=4235f90e4db94284adec59aa60035bf6)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:24.539792 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e27852-d517-4652-8269-5db98fd2a9c3 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:24.540043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31387bfc-e70c-4b19-8c45-6ec3142965c0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:24.572479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23457a26-0ecb-4413-a81f-a81cafa2ea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:24.573135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23457a26-0ecb-4413-a81f-a81cafa2ea40 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:24.573417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23457a26-0ecb-4413-a81f-a81cafa2ea40 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:24.573692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23457a26-0ecb-4413-a81f-a81cafa2ea40 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:24.574523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23457a26-0ecb-4413-a81f-a81cafa2ea40 None admin] RBAC: Adding query filter params (type=network) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:24.574827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23457a26-0ecb-4413-a81f-a81cafa2ea40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:24.576191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23457a26-0ecb-4413-a81f-a81cafa2ea40 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:24.581267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 403/824] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:24.586765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23457a26-0ecb-4413-a81f-a81cafa2ea40 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.609729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 422/825] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:24 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/8f9bad450f474e5a835d7c70b210e60e/roles/4235f90e4db94284adec59aa60035bf6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:56:24.610782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27852-d517-4652-8269-5db98fd2a9c3 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.704247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23457a26-0ecb-4413-a81f-a81cafa2ea40 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:24.718507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e27852-d517-4652-8269-5db98fd2a9c3 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:24.750020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d663-2c7a-42e3-96e6-df21bb8b3417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:24.751395 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d663-2c7a-42e3-96e6-df21bb8b3417 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:24.751921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d663-2c7a-42e3-96e6-df21bb8b3417 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:24.752343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d663-2c7a-42e3-96e6-df21bb8b3417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:24.754787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824946-7be6-4302-9b33-89dffd2b0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:24.755454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824946-7be6-4302-9b33-89dffd2b0836 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:24.755783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824946-7be6-4302-9b33-89dffd2b0836 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:24.756057 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824946-7be6-4302-9b33-89dffd2b0836 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:24.756807 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824946-7be6-4302-9b33-89dffd2b0836 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:24.758248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824946-7be6-4302-9b33-89dffd2b0836 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:24.765202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d663-2c7a-42e3-96e6-df21bb8b3417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:24.767729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d663-2c7a-42e3-96e6-df21bb8b3417 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-fc01d663-2c7a-42e3-96e6-df21bb8b3417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:24.787488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:24.788595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:24.794308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:24.794308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:24.794308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:24.794308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:24.794308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 404/826] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:24.794308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d663-2c7a-42e3-96e6-df21bb8b3417 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.867715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 423/827] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 16 14:56:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:24.868787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824946-7be6-4302-9b33-89dffd2b0836 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:24.948416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d663-2c7a-42e3-96e6-df21bb8b3417 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:25.002682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824946-7be6-4302-9b33-89dffd2b0836 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:25.030858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac489d8e-0fc8-4e54-8dc6-9aa635d155eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:25.031543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac489d8e-0fc8-4e54-8dc6-9aa635d155eb None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.031824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac489d8e-0fc8-4e54-8dc6-9aa635d155eb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.032098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac489d8e-0fc8-4e54-8dc6-9aa635d155eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.032878 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac489d8e-0fc8-4e54-8dc6-9aa635d155eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:25.034300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac489d8e-0fc8-4e54-8dc6-9aa635d155eb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:25.038315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656d77e-0e25-452d-b12c-e7f80dc437b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:25.039070 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656d77e-0e25-452d-b12c-e7f80dc437b0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.039614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656d77e-0e25-452d-b12c-e7f80dc437b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.039987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656d77e-0e25-452d-b12c-e7f80dc437b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.040871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656d77e-0e25-452d-b12c-e7f80dc437b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:25.041318 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656d77e-0e25-452d-b12c-e7f80dc437b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:25.042843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656d77e-0e25-452d-b12c-e7f80dc437b0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:25.056490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 424/828] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:25.061941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656d77e-0e25-452d-b12c-e7f80dc437b0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:25.136903 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 405/829] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 16 14:56:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:25.159789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6986b7-b0d8-403f-906e-601f028c25d2 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.166921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6986b7-b0d8-403f-906e-601f028c25d2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.166921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6986b7-b0d8-403f-906e-601f028c25d2 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.166921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 406/830] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:25.168112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28e982-4f31-40de-adbd-5ef08a33a869 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.168498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28e982-4f31-40de-adbd-5ef08a33a869 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.168873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28e982-4f31-40de-adbd-5ef08a33a869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.184373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656d77e-0e25-452d-b12c-e7f80dc437b0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:25.191065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8f28e982-4f31-40de-adbd-5ef08a33a869 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:25.192508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8f28e982-4f31-40de-adbd-5ef08a33a869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:25.230395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48a2fb-6a37-4c2e-94e3-bfa3723668c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:25.231200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48a2fb-6a37-4c2e-94e3-bfa3723668c0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.231526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48a2fb-6a37-4c2e-94e3-bfa3723668c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.231801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48a2fb-6a37-4c2e-94e3-bfa3723668c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.239741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48a2fb-6a37-4c2e-94e3-bfa3723668c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:25.241294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48a2fb-6a37-4c2e-94e3-bfa3723668c0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-be48a2fb-6a37-4c2e-94e3-bfa3723668c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:25.256791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:25.257923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:25.259222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:25.259222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:25.259222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:25.259222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:25.259222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:25.259222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:25.259222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:25.259222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:25.259222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 425/831] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:25.264209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48a2fb-6a37-4c2e-94e3-bfa3723668c0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:25.272471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 407/832] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:25.297623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28e982-4f31-40de-adbd-5ef08a33a869 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:25.372953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48a2fb-6a37-4c2e-94e3-bfa3723668c0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:25.402982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28e982-4f31-40de-adbd-5ef08a33a869 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:25.407583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823f419-7ce0-4870-bb0d-c805010c815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:25.408874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823f419-7ce0-4870-bb0d-c805010c815a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.409157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823f419-7ce0-4870-bb0d-c805010c815a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.409432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823f419-7ce0-4870-bb0d-c805010c815a None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.410545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823f419-7ce0-4870-bb0d-c805010c815a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:25.410971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823f419-7ce0-4870-bb0d-c805010c815a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:25.413087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823f419-7ce0-4870-bb0d-c805010c815a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:25.427477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 426/833] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:25.433360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823f419-7ce0-4870-bb0d-c805010c815a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:25.439935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34517a-884a-432f-b0d1-f24a7f7d7726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:25.440929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34517a-884a-432f-b0d1-f24a7f7d7726 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.441424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34517a-884a-432f-b0d1-f24a7f7d7726 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.441843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34517a-884a-432f-b0d1-f24a7f7d7726 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.452607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34517a-884a-432f-b0d1-f24a7f7d7726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0a34517a-884a-432f-b0d1-f24a7f7d7726 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:25.460896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:25.462043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:25.463283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:25.470076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 408/834] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:25.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34517a-884a-432f-b0d1-f24a7f7d7726 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:25.537016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823f419-7ce0-4870-bb0d-c805010c815a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:25.570982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34517a-884a-432f-b0d1-f24a7f7d7726 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:25.573083 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef22c72-56ad-485f-8fb2-936905085f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:25.574229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef22c72-56ad-485f-8fb2-936905085f47 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.574229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef22c72-56ad-485f-8fb2-936905085f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.574456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef22c72-56ad-485f-8fb2-936905085f47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.575181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef22c72-56ad-485f-8fb2-936905085f47 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=dc19a5d9ce774f39aa49ab7c64ba682e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:25.575491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef22c72-56ad-485f-8fb2-936905085f47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:25.576929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef22c72-56ad-485f-8fb2-936905085f47 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:25.583969 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 427/835] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:25 2022] GET /identity/v3/role_assignments?user.id=dc19a5d9ce774f39aa49ab7c64ba682e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=042169a166e14a80beac826291ceaf73 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:25.608823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86dae8-8fa2-482a-b7fc-a1ba3a9b9689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:25.609786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86dae8-8fa2-482a-b7fc-a1ba3a9b9689 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.610242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86dae8-8fa2-482a-b7fc-a1ba3a9b9689 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.610670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86dae8-8fa2-482a-b7fc-a1ba3a9b9689 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.611627 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86dae8-8fa2-482a-b7fc-a1ba3a9b9689 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:25.612078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86dae8-8fa2-482a-b7fc-a1ba3a9b9689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:25.613620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86dae8-8fa2-482a-b7fc-a1ba3a9b9689 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:25.628017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 409/836] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:25.629671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef22c72-56ad-485f-8fb2-936905085f47 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:25.734512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef22c72-56ad-485f-8fb2-936905085f47 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:25.769867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851d2a0-7e3c-482b-bcdd-66bb60ba72a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:25.771000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d2a0-7e3c-482b-bcdd-66bb60ba72a1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.771427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d2a0-7e3c-482b-bcdd-66bb60ba72a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.771862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d2a0-7e3c-482b-bcdd-66bb60ba72a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.785905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851d2a0-7e3c-482b-bcdd-66bb60ba72a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:25.787671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851d2a0-7e3c-482b-bcdd-66bb60ba72a1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-8851d2a0-7e3c-482b-bcdd-66bb60ba72a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:25.808156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:25.809299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:25.810410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:25.810410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:25.810410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:25.810410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:25.817441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 428/837] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:25.819107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86dae8-8fa2-482a-b7fc-a1ba3a9b9689 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:25.925541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86dae8-8fa2-482a-b7fc-a1ba3a9b9689 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:25.959204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c383-a75e-4ec8-8f53-725ef520e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:25.960107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c383-a75e-4ec8-8f53-725ef520e529 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:25.960558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c383-a75e-4ec8-8f53-725ef520e529 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:25.960974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c383-a75e-4ec8-8f53-725ef520e529 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:25.961833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31c383-a75e-4ec8-8f53-725ef520e529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:25.962339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31c383-a75e-4ec8-8f53-725ef520e529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:25.964137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31c383-a75e-4ec8-8f53-725ef520e529 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:25.980776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 410/838] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:25.982433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851d2a0-7e3c-482b-bcdd-66bb60ba72a1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:26.086375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851d2a0-7e3c-482b-bcdd-66bb60ba72a1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:26.120374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8afa92-44c7-40e3-a3f9-971067d1f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:26.121315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8afa92-44c7-40e3-a3f9-971067d1f679 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:26.121698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8afa92-44c7-40e3-a3f9-971067d1f679 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:26.122094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8afa92-44c7-40e3-a3f9-971067d1f679 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:26.129215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8afa92-44c7-40e3-a3f9-971067d1f679 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:26.130786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8afa92-44c7-40e3-a3f9-971067d1f679 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-0d8afa92-44c7-40e3-a3f9-971067d1f679 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:26.145510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:26.146684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 14:56:26.148032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:26.149757 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 429/839] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:26.155399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c383-a75e-4ec8-8f53-725ef520e529 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:26.253163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c383-a75e-4ec8-8f53-725ef520e529 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:26.287007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406700-599d-47e2-a532-0364a37d60d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:26.287946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406700-599d-47e2-a532-0364a37d60d0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:26.288436 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406700-599d-47e2-a532-0364a37d60d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:26.288848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406700-599d-47e2-a532-0364a37d60d0 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:26.289820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406700-599d-47e2-a532-0364a37d60d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:26.290309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406700-599d-47e2-a532-0364a37d60d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:26.291864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406700-599d-47e2-a532-0364a37d60d0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:26.314692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 411/840] 10.222.0.44 () {56 vars in 1135 bytes} [Mon May 16 14:56:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:26.326442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8afa92-44c7-40e3-a3f9-971067d1f679 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:26.418293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8afa92-44c7-40e3-a3f9-971067d1f679 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:26.453089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a013b07-b03c-4388-9635-80fa33d64754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:26.453744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013b07-b03c-4388-9635-80fa33d64754 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:26.454099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013b07-b03c-4388-9635-80fa33d64754 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:26.454380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013b07-b03c-4388-9635-80fa33d64754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:26.522968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a013b07-b03c-4388-9635-80fa33d64754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:26.524342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a013b07-b03c-4388-9635-80fa33d64754 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:26.622459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 430/841] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:56:26.627859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406700-599d-47e2-a532-0364a37d60d0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:26.724466 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406700-599d-47e2-a532-0364a37d60d0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:26.757914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496abdf-2034-43d9-866e-a3787ee3bc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:26.758761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496abdf-2034-43d9-866e-a3787ee3bc6c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:26.759034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496abdf-2034-43d9-866e-a3787ee3bc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:26.759299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496abdf-2034-43d9-866e-a3787ee3bc6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:26.771549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496abdf-2034-43d9-866e-a3787ee3bc6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:26.773092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496abdf-2034-43d9-866e-a3787ee3bc6c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-a496abdf-2034-43d9-866e-a3787ee3bc6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:26.792689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:26.794886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:26.797276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:26.797276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:26.797276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:26.797276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:26.802102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 412/842] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:26.807186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a013b07-b03c-4388-9635-80fa33d64754 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:26.905299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a013b07-b03c-4388-9635-80fa33d64754 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:26.938435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf06ad-7e86-4c33-b0c9-7e8bb5aad7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:26.939984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf06ad-7e86-4c33-b0c9-7e8bb5aad7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:26.940441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf06ad-7e86-4c33-b0c9-7e8bb5aad7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:26.940856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf06ad-7e86-4c33-b0c9-7e8bb5aad7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:26.941749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf06ad-7e86-4c33-b0c9-7e8bb5aad7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:26.942215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf06ad-7e86-4c33-b0c9-7e8bb5aad7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:26.943840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf06ad-7e86-4c33-b0c9-7e8bb5aad7c3 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:26.948826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994fd4-2844-45b5-a051-be1d5b5144e6 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:26.949109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994fd4-2844-45b5-a051-be1d5b5144e6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:26.949444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994fd4-2844-45b5-a051-be1d5b5144e6 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:26.951089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 413/843] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:26.956016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0120763-ad05-49da-9f02-58020c0c7888 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:26.956299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0120763-ad05-49da-9f02-58020c0c7888 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:26.956573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0120763-ad05-49da-9f02-58020c0c7888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:26.961332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 431/844] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:26.963568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf06ad-7e86-4c33-b0c9-7e8bb5aad7c3 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:26.974383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c0120763-ad05-49da-9f02-58020c0c7888 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:26.975542 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c0120763-ad05-49da-9f02-58020c0c7888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:27.049198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 414/845] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:27.073291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0120763-ad05-49da-9f02-58020c0c7888 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:27.090431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf06ad-7e86-4c33-b0c9-7e8bb5aad7c3 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.123488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354f3a3-0cb4-4940-82f9-95d776ed8a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:27.124274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354f3a3-0cb4-4940-82f9-95d776ed8a59 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.124551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354f3a3-0cb4-4940-82f9-95d776ed8a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.124880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354f3a3-0cb4-4940-82f9-95d776ed8a59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.132499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354f3a3-0cb4-4940-82f9-95d776ed8a59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:27.134173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354f3a3-0cb4-4940-82f9-95d776ed8a59 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-5354f3a3-0cb4-4940-82f9-95d776ed8a59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:27.148235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:27.149139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:27.150352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:27.150352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:27.150352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:27.150352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:27.150352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:27.150352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:27.150352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:27.150352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:27.150352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 432/846] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:27.155394 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354f3a3-0cb4-4940-82f9-95d776ed8a59 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:27.177399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0120763-ad05-49da-9f02-58020c0c7888 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.216661 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb85d-5bef-48ef-9a43-a0be5ae9bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:27.217551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb85d-5bef-48ef-9a43-a0be5ae9bcfe None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.217963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb85d-5bef-48ef-9a43-a0be5ae9bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.218476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeb85d-5bef-48ef-9a43-a0be5ae9bcfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.232226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeb85d-5bef-48ef-9a43-a0be5ae9bcfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c2eeb85d-5bef-48ef-9a43-a0be5ae9bcfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:27.242811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:27.243738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:27.244762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 415/847] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:27.251393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb85d-5bef-48ef-9a43-a0be5ae9bcfe None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:27.256940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354f3a3-0cb4-4940-82f9-95d776ed8a59 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.290807 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28478218-a0cb-4684-9c0a-1ba14206a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:27.291465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28478218-a0cb-4684-9c0a-1ba14206a14b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.291750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28478218-a0cb-4684-9c0a-1ba14206a14b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.292029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28478218-a0cb-4684-9c0a-1ba14206a14b None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.292817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28478218-a0cb-4684-9c0a-1ba14206a14b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:27.293128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28478218-a0cb-4684-9c0a-1ba14206a14b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:27.294639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28478218-a0cb-4684-9c0a-1ba14206a14b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:27.307057 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 433/848] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:27.312996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28478218-a0cb-4684-9c0a-1ba14206a14b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:27.370993 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeb85d-5bef-48ef-9a43-a0be5ae9bcfe None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.405672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98334711-7153-4c5c-ac33-eb353bff5a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:27.406388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98334711-7153-4c5c-ac33-eb353bff5a14 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.406672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98334711-7153-4c5c-ac33-eb353bff5a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.406948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98334711-7153-4c5c-ac33-eb353bff5a14 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.408348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98334711-7153-4c5c-ac33-eb353bff5a14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:27.408663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98334711-7153-4c5c-ac33-eb353bff5a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:27.410038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98334711-7153-4c5c-ac33-eb353bff5a14 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:27.418870 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 416/849] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:27.427574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98334711-7153-4c5c-ac33-eb353bff5a14 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:27.440679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28478218-a0cb-4684-9c0a-1ba14206a14b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.484706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984555-757a-483f-9d3b-59d9326c682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:27.485651 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984555-757a-483f-9d3b-59d9326c682a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.485999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984555-757a-483f-9d3b-59d9326c682a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.486307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984555-757a-483f-9d3b-59d9326c682a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.487307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984555-757a-483f-9d3b-59d9326c682a None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=6a6668cb0bda4d61b6b96f547a422830) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:27.487924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984555-757a-483f-9d3b-59d9326c682a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:27.489622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984555-757a-483f-9d3b-59d9326c682a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:27.497833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 434/850] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/role_assignments?user.id=6a6668cb0bda4d61b6b96f547a422830&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=042169a166e14a80beac826291ceaf73 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:27.516706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329ae0-d7db-4260-95dd-b48d35b61d37 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.517056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329ae0-d7db-4260-95dd-b48d35b61d37 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.517917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329ae0-d7db-4260-95dd-b48d35b61d37 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.523805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 435/851] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:27.525274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab1afa-914f-4896-91c8-ceb70ebb62ce None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.525562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab1afa-914f-4896-91c8-ceb70ebb62ce None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.525838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab1afa-914f-4896-91c8-ceb70ebb62ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.531699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98334711-7153-4c5c-ac33-eb353bff5a14 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.551848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e6ab1afa-914f-4896-91c8-ceb70ebb62ce None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:27.553806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e6ab1afa-914f-4896-91c8-ceb70ebb62ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:27.573457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30004622-904c-45f4-906c-5a8df8e22b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:27.574208 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004622-904c-45f4-906c-5a8df8e22b7a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.574544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004622-904c-45f4-906c-5a8df8e22b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.574813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004622-904c-45f4-906c-5a8df8e22b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.588369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30004622-904c-45f4-906c-5a8df8e22b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:27.589862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30004622-904c-45f4-906c-5a8df8e22b7a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-30004622-904c-45f4-906c-5a8df8e22b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:27.610681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:27.612172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:27.613064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:27.613064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:27.613064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:27.613064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:27.615145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 417/852] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:27.620778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30004622-904c-45f4-906c-5a8df8e22b7a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:27.640468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 436/853] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:27.664063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab1afa-914f-4896-91c8-ceb70ebb62ce None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:27.730747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30004622-904c-45f4-906c-5a8df8e22b7a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.771872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8cf0-e63c-4762-8b7a-359180aab961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:27.772650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8cf0-e63c-4762-8b7a-359180aab961 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.772934 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8cf0-e63c-4762-8b7a-359180aab961 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.773209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c8cf0-e63c-4762-8b7a-359180aab961 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.773932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8cf0-e63c-4762-8b7a-359180aab961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:27.774262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8cf0-e63c-4762-8b7a-359180aab961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:27.775250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab1afa-914f-4896-91c8-ceb70ebb62ce None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.775637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c8cf0-e63c-4762-8b7a-359180aab961 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:27.795557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 418/854] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:27.797029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8cf0-e63c-4762-8b7a-359180aab961 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:27.815958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a8612-d745-40c6-a66d-b3e4e2598183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:27.816790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a8612-d745-40c6-a66d-b3e4e2598183 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.817069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a8612-d745-40c6-a66d-b3e4e2598183 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.817334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a8612-d745-40c6-a66d-b3e4e2598183 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.817987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a8612-d745-40c6-a66d-b3e4e2598183 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:27.819470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a8612-d745-40c6-a66d-b3e4e2598183 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-251a8612-d745-40c6-a66d-b3e4e2598183 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:27.832090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:27.833085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:27.834398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 437/855] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:27.839537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a8612-d745-40c6-a66d-b3e4e2598183 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:27.922785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c8cf0-e63c-4762-8b7a-359180aab961 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.958138 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4faa4-cde3-4fdd-b4f5-3771f5e1ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:27.959203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4faa4-cde3-4fdd-b4f5-3771f5e1ba84 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:27.959203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4faa4-cde3-4fdd-b4f5-3771f5e1ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:27.959531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4faa4-cde3-4fdd-b4f5-3771f5e1ba84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:27.967379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4faa4-cde3-4fdd-b4f5-3771f5e1ba84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:27.968871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4faa4-cde3-4fdd-b4f5-3771f5e1ba84 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:27.969480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a8612-d745-40c6-a66d-b3e4e2598183 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c8b4faa4-cde3-4fdd-b4f5-3771f5e1ba84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:27.983615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:27.984590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:27.985536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:27.989503 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 419/856] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:27.990410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4faa4-cde3-4fdd-b4f5-3771f5e1ba84 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:28.010719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de97b39-8b7f-41d6-844b-a5ab6ff41c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:28.011416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de97b39-8b7f-41d6-844b-a5ab6ff41c47 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.011695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de97b39-8b7f-41d6-844b-a5ab6ff41c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.012016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de97b39-8b7f-41d6-844b-a5ab6ff41c47 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.012723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de97b39-8b7f-41d6-844b-a5ab6ff41c47 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:28.013027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de97b39-8b7f-41d6-844b-a5ab6ff41c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:28.014530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de97b39-8b7f-41d6-844b-a5ab6ff41c47 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:28.024699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 438/857] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:28.025580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de97b39-8b7f-41d6-844b-a5ab6ff41c47 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:28.097377 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4faa4-cde3-4fdd-b4f5-3771f5e1ba84 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:28.128592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de97b39-8b7f-41d6-844b-a5ab6ff41c47 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:28.131167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500f86f-5cd5-40a4-a006-5c2beb399840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:28.131832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500f86f-5cd5-40a4-a006-5c2beb399840 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.132107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500f86f-5cd5-40a4-a006-5c2beb399840 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.132372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500f86f-5cd5-40a4-a006-5c2beb399840 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.133193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500f86f-5cd5-40a4-a006-5c2beb399840 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:28.133496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500f86f-5cd5-40a4-a006-5c2beb399840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:28.134944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500f86f-5cd5-40a4-a006-5c2beb399840 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:28.151870 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 420/858] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 16 14:56:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:28.153126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a6e7-f165-4e19-930f-ec64bf555eda None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.153404 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a6e7-f165-4e19-930f-ec64bf555eda None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.153674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a6e7-f165-4e19-930f-ec64bf555eda None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.155081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 421/859] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:28.157231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a6e7-f165-4e19-930f-ec64bf555eda None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:28.169554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064dec7-bc54-4779-ac2e-e6d304be3437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:28.170254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064dec7-bc54-4779-ac2e-e6d304be3437 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.170534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064dec7-bc54-4779-ac2e-e6d304be3437 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.170803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064dec7-bc54-4779-ac2e-e6d304be3437 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.171506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064dec7-bc54-4779-ac2e-e6d304be3437 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:28.171810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064dec7-bc54-4779-ac2e-e6d304be3437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:28.173166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064dec7-bc54-4779-ac2e-e6d304be3437 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:28.178444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 439/860] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:56:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:28.179641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e481-bb52-4386-926d-7b7be573e42f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.179931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e481-bb52-4386-926d-7b7be573e42f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.180210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e481-bb52-4386-926d-7b7be573e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.206788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-73e5e481-bb52-4386-926d-7b7be573e42f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:28.208080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-73e5e481-bb52-4386-926d-7b7be573e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:28.290322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a6e7-f165-4e19-930f-ec64bf555eda None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:28.298023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 440/861] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:28.315598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5e481-bb52-4386-926d-7b7be573e42f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:28.334402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33f5e5-e784-40b7-93f3-ecf862591df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:28.335067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33f5e5-e784-40b7-93f3-ecf862591df0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.335345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33f5e5-e784-40b7-93f3-ecf862591df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.335615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33f5e5-e784-40b7-93f3-ecf862591df0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.428837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33f5e5-e784-40b7-93f3-ecf862591df0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:28.430728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33f5e5-e784-40b7-93f3-ecf862591df0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:28.438753 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5e481-bb52-4386-926d-7b7be573e42f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:28.474694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cad36-54c3-47e0-a10b-224cb4fd221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:28.476288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cad36-54c3-47e0-a10b-224cb4fd221a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.476640 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cad36-54c3-47e0-a10b-224cb4fd221a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.476991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cad36-54c3-47e0-a10b-224cb4fd221a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.477728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cad36-54c3-47e0-a10b-224cb4fd221a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:28.479206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cad36-54c3-47e0-a10b-224cb4fd221a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-a68cad36-54c3-47e0-a10b-224cb4fd221a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:28.491502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:28.492455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:28.493282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 441/862] 10.222.0.44 () {56 vars in 1132 bytes} [Mon May 16 14:56:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:28.498851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cad36-54c3-47e0-a10b-224cb4fd221a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:28.558153 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 422/863] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 14:56:28.561750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33f5e5-e784-40b7-93f3-ecf862591df0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:28.614858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cad36-54c3-47e0-a10b-224cb4fd221a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:28.648730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9f4f1-f2a0-41d9-a53b-753bd5bd999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:28.649754 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9f4f1-f2a0-41d9-a53b-753bd5bd999f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.650269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9f4f1-f2a0-41d9-a53b-753bd5bd999f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.650759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9f4f1-f2a0-41d9-a53b-753bd5bd999f None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.651684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9f4f1-f2a0-41d9-a53b-753bd5bd999f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:28.652220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9f4f1-f2a0-41d9-a53b-753bd5bd999f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:28.653804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9f4f1-f2a0-41d9-a53b-753bd5bd999f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:28.659384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 442/864] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:28.665204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9f4f1-f2a0-41d9-a53b-753bd5bd999f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:28.668802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33f5e5-e784-40b7-93f3-ecf862591df0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:28.717140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620acfa-e423-4f79-bc76-1d83c2f311eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:28.718221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620acfa-e423-4f79-bc76-1d83c2f311eb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.718514 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620acfa-e423-4f79-bc76-1d83c2f311eb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.718784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620acfa-e423-4f79-bc76-1d83c2f311eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.730458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620acfa-e423-4f79-bc76-1d83c2f311eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:28.731981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620acfa-e423-4f79-bc76-1d83c2f311eb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-3620acfa-e423-4f79-bc76-1d83c2f311eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:28.753974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:28.754946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:28.755843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:28.755843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:28.755843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:28.755843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:28.755843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 423/865] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:28.762990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620acfa-e423-4f79-bc76-1d83c2f311eb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:28.793190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9f4f1-f2a0-41d9-a53b-753bd5bd999f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:28.836766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edd32d-1afb-495c-9424-cd56d25f954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:28.837687 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edd32d-1afb-495c-9424-cd56d25f954a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.838419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edd32d-1afb-495c-9424-cd56d25f954a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.838890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edd32d-1afb-495c-9424-cd56d25f954a None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.839750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edd32d-1afb-495c-9424-cd56d25f954a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:28.840672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edd32d-1afb-495c-9424-cd56d25f954a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:28.842350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edd32d-1afb-495c-9424-cd56d25f954a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:28.857004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 443/866] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:28.877221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620acfa-e423-4f79-bc76-1d83c2f311eb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:28.912745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e1ae6-83f8-465d-85ce-f8c9170baa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:28.913416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e1ae6-83f8-465d-85ce-f8c9170baa00 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:28.913694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e1ae6-83f8-465d-85ce-f8c9170baa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:28.913963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e1ae6-83f8-465d-85ce-f8c9170baa00 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:28.914723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e1ae6-83f8-465d-85ce-f8c9170baa00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:28.915026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e1ae6-83f8-465d-85ce-f8c9170baa00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:28.916417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e1ae6-83f8-465d-85ce-f8c9170baa00 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:28.929418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 424/867] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:28.935094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edd32d-1afb-495c-9424-cd56d25f954a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:29.051696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edd32d-1afb-495c-9424-cd56d25f954a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:29.092579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade95e-d038-40f6-bf0d-c8f81f71fc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:29.093654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade95e-d038-40f6-bf0d-c8f81f71fc70 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:29.094202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade95e-d038-40f6-bf0d-c8f81f71fc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:29.094681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade95e-d038-40f6-bf0d-c8f81f71fc70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:29.101773 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade95e-d038-40f6-bf0d-c8f81f71fc70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:29.103496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade95e-d038-40f6-bf0d-c8f81f71fc70 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-45ade95e-d038-40f6-bf0d-c8f81f71fc70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:29.118037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:29.118964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:29.119853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:29.119853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:29.119853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:29.119853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:29.119853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:29.119853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:29.119853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:29.119853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:29.122307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 444/868] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:29.128200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e1ae6-83f8-465d-85ce-f8c9170baa00 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:29.228595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e1ae6-83f8-465d-85ce-f8c9170baa00 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:29.262006 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c781c-a36e-459d-bc69-482ca6602e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:29.262762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c781c-a36e-459d-bc69-482ca6602e98 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:29.263042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c781c-a36e-459d-bc69-482ca6602e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:29.263315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c781c-a36e-459d-bc69-482ca6602e98 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:29.264093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c781c-a36e-459d-bc69-482ca6602e98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:29.264396 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c781c-a36e-459d-bc69-482ca6602e98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:29.265826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c781c-a36e-459d-bc69-482ca6602e98 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:29.278243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 425/869] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:29.283726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade95e-d038-40f6-bf0d-c8f81f71fc70 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:29.386671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade95e-d038-40f6-bf0d-c8f81f71fc70 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:29.421815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a677655-942e-4f2b-9f8e-784b091ff257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:29.422508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a677655-942e-4f2b-9f8e-784b091ff257 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:29.422791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a677655-942e-4f2b-9f8e-784b091ff257 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:29.423064 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a677655-942e-4f2b-9f8e-784b091ff257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:29.423933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a677655-942e-4f2b-9f8e-784b091ff257 None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=8f9bad450f474e5a835d7c70b210e60e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:29.424242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a677655-942e-4f2b-9f8e-784b091ff257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:29.425706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a677655-942e-4f2b-9f8e-784b091ff257 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:29.432167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 445/870] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:29 2022] GET /identity/v3/role_assignments?user.id=8f9bad450f474e5a835d7c70b210e60e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:29.850970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6475e-c792-4f76-b1d3-2643bc46ddf2 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:29.851491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6475e-c792-4f76-b1d3-2643bc46ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:29.851491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6475e-c792-4f76-b1d3-2643bc46ddf2 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:29.853375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 426/871] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:29.861352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ba03c-9c55-4740-8094-12114857a7ea None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:29.861352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ba03c-9c55-4740-8094-12114857a7ea None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:29.861352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ba03c-9c55-4740-8094-12114857a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:29.877692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-271ba03c-9c55-4740-8094-12114857a7ea None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:29.879213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-271ba03c-9c55-4740-8094-12114857a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:29.949151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 446/872] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:29.970799 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6475e-c792-4f76-b1d3-2643bc46ddf2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:30.083340 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6475e-c792-4f76-b1d3-2643bc46ddf2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:30.120570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ef53a-fc26-47f0-9d4a-291ecace6827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:30.121299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ef53a-fc26-47f0-9d4a-291ecace6827 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:30.121581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ef53a-fc26-47f0-9d4a-291ecace6827 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:30.121850 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ef53a-fc26-47f0-9d4a-291ecace6827 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:30.122593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ef53a-fc26-47f0-9d4a-291ecace6827 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:30.124021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ef53a-fc26-47f0-9d4a-291ecace6827 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-459ef53a-fc26-47f0-9d4a-291ecace6827 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:30.136703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:30.137672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:30.138768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 427/873] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:30.146170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ba03c-9c55-4740-8094-12114857a7ea None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:30.242386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ba03c-9c55-4740-8094-12114857a7ea None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:30.280828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5298c8-3e2f-4d61-baa3-482e9b0d1c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:30.281523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5298c8-3e2f-4d61-baa3-482e9b0d1c8f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:30.281805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5298c8-3e2f-4d61-baa3-482e9b0d1c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:30.282101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5298c8-3e2f-4d61-baa3-482e9b0d1c8f None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:30.283371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5298c8-3e2f-4d61-baa3-482e9b0d1c8f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:30.283680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5298c8-3e2f-4d61-baa3-482e9b0d1c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:30.285110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5298c8-3e2f-4d61-baa3-482e9b0d1c8f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:30.290914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 447/874] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:30.296685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ef53a-fc26-47f0-9d4a-291ecace6827 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:30.397182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ef53a-fc26-47f0-9d4a-291ecace6827 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:30.431246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aeacbc-057d-4445-9372-260fd07618a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:30.432251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeacbc-057d-4445-9372-260fd07618a7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:30.432729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeacbc-057d-4445-9372-260fd07618a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:30.433199 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeacbc-057d-4445-9372-260fd07618a7 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:30.434160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aeacbc-057d-4445-9372-260fd07618a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:30.434674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aeacbc-057d-4445-9372-260fd07618a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:30.436217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aeacbc-057d-4445-9372-260fd07618a7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:30.450203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 428/875] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:30.456570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a33229-8a38-484f-8484-f9be399f09cf None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:30.456932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a33229-8a38-484f-8484-f9be399f09cf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:30.457127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a33229-8a38-484f-8484-f9be399f09cf None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:30.459072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 448/876] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:30.465124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441d9ea-1f45-43dc-97cb-ab053f0c0ff6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:30.465416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441d9ea-1f45-43dc-97cb-ab053f0c0ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:30.465679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441d9ea-1f45-43dc-97cb-ab053f0c0ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:30.484037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b441d9ea-1f45-43dc-97cb-ab053f0c0ff6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:30.485224 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b441d9ea-1f45-43dc-97cb-ab053f0c0ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:30.557331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 429/877] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:30.580571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a33229-8a38-484f-8484-f9be399f09cf None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:30.684787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a33229-8a38-484f-8484-f9be399f09cf None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:30.717976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142741c-ec7b-4267-93ae-d01801e1871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:30.718662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142741c-ec7b-4267-93ae-d01801e1871b None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:30.718944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142741c-ec7b-4267-93ae-d01801e1871b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:30.719205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142741c-ec7b-4267-93ae-d01801e1871b None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:30.719995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142741c-ec7b-4267-93ae-d01801e1871b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:30.721962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142741c-ec7b-4267-93ae-d01801e1871b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:30.810437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 449/878] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:56:30 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:31.219237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fa8bc-6438-4a3e-b5cb-94fca9b9a2da None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:31.219790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fa8bc-6438-4a3e-b5cb-94fca9b9a2da None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:31.219790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fa8bc-6438-4a3e-b5cb-94fca9b9a2da None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:31.221890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 430/879] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:31.227394 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de461-6786-40d8-93ec-c985a982e620 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:31.227833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de461-6786-40d8-93ec-c985a982e620 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:31.228013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de461-6786-40d8-93ec-c985a982e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:31.245352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3f3de461-6786-40d8-93ec-c985a982e620 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:31.246565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3f3de461-6786-40d8-93ec-c985a982e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:31.321173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 450/880] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:31.345499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fa8bc-6438-4a3e-b5cb-94fca9b9a2da None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:31.447951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fa8bc-6438-4a3e-b5cb-94fca9b9a2da None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:31.481003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333572d-94a8-469a-be98-063202dd4c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:31.481661 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333572d-94a8-469a-be98-063202dd4c66 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:31.481936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333572d-94a8-469a-be98-063202dd4c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:31.482233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333572d-94a8-469a-be98-063202dd4c66 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:31.482964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333572d-94a8-469a-be98-063202dd4c66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:31.484330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333572d-94a8-469a-be98-063202dd4c66 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:31.583395 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 431/881] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:56:31 2022] POST /identity/v3/services => generated 269 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:31.883610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7692c9-714a-4951-95a6-3ad9bb29ffb1 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:31.883610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7692c9-714a-4951-95a6-3ad9bb29ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:31.883610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7692c9-714a-4951-95a6-3ad9bb29ffb1 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:31.884405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 451/882] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:31.889898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ac067-9252-4e89-a8ec-eb07a48181c5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:31.890439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ac067-9252-4e89-a8ec-eb07a48181c5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:31.890924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ac067-9252-4e89-a8ec-eb07a48181c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:31.908138 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a20ac067-9252-4e89-a8ec-eb07a48181c5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:31.909735 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a20ac067-9252-4e89-a8ec-eb07a48181c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:31.989781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 432/883] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:32.013773 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7692c9-714a-4951-95a6-3ad9bb29ffb1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:32.115717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7692c9-714a-4951-95a6-3ad9bb29ffb1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:32.149406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6058721-aceb-4f87-9209-2b71b0bf4fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:32.150181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6058721-aceb-4f87-9209-2b71b0bf4fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:32.150461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6058721-aceb-4f87-9209-2b71b0bf4fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:32.150732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6058721-aceb-4f87-9209-2b71b0bf4fa6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:32.161760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6058721-aceb-4f87-9209-2b71b0bf4fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-f6058721-aceb-4f87-9209-2b71b0bf4fa6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:32.170209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:32.171122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:32.171951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 452/884] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 16 14:56:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:32.177573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ac067-9252-4e89-a8ec-eb07a48181c5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:32.280807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ac067-9252-4e89-a8ec-eb07a48181c5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:32.314165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8387012-ae63-4359-9fde-1cefd33bbbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:32.314834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8387012-ae63-4359-9fde-1cefd33bbbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:32.315115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8387012-ae63-4359-9fde-1cefd33bbbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:32.315392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8387012-ae63-4359-9fde-1cefd33bbbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:32.316132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8387012-ae63-4359-9fde-1cefd33bbbc0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:32.324032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8387012-ae63-4359-9fde-1cefd33bbbc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:32.324032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8387012-ae63-4359-9fde-1cefd33bbbc0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:32.326413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 433/885] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 16 14:56:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:32.335351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6058721-aceb-4f87-9209-2b71b0bf4fa6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:32.434331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6058721-aceb-4f87-9209-2b71b0bf4fa6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:32.467317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daae3b9-7321-48a9-9787-c80c019fa36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:32.468112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daae3b9-7321-48a9-9787-c80c019fa36f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:32.468392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daae3b9-7321-48a9-9787-c80c019fa36f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:32.468669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daae3b9-7321-48a9-9787-c80c019fa36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:32.479759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daae3b9-7321-48a9-9787-c80c019fa36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:32.481208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daae3b9-7321-48a9-9787-c80c019fa36f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-2daae3b9-7321-48a9-9787-c80c019fa36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:32.498513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:32.499442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:32.500445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:32.500445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:32.500445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:32.500445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:32.500445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 453/886] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:32.506794 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8387012-ae63-4359-9fde-1cefd33bbbc0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:32.610471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8387012-ae63-4359-9fde-1cefd33bbbc0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:32.645300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30b6e0-3081-41b4-9724-42f11a1e2b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:32.645972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30b6e0-3081-41b4-9724-42f11a1e2b49 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:32.646277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30b6e0-3081-41b4-9724-42f11a1e2b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:32.646548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30b6e0-3081-41b4-9724-42f11a1e2b49 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:32.647264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30b6e0-3081-41b4-9724-42f11a1e2b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:32.647567 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30b6e0-3081-41b4-9724-42f11a1e2b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:32.648942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30b6e0-3081-41b4-9724-42f11a1e2b49 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:32.660929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 434/887] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:32.666529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daae3b9-7321-48a9-9787-c80c019fa36f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:32.737470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b51fb-3fec-437f-b910-be63896f24f4 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:32.737775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b51fb-3fec-437f-b910-be63896f24f4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:32.737942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b51fb-3fec-437f-b910-be63896f24f4 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:32.740751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 435/888] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:32.744713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f37e6-c1d5-4d8b-b238-a37f04283010 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:32.744999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f37e6-c1d5-4d8b-b238-a37f04283010 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:32.745276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f37e6-c1d5-4d8b-b238-a37f04283010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:32.761591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2b8f37e6-c1d5-4d8b-b238-a37f04283010 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:32.762822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2b8f37e6-c1d5-4d8b-b238-a37f04283010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:32.771364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daae3b9-7321-48a9-9787-c80c019fa36f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:32.807428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710f994-0afe-4a21-bffa-745f2c0a0ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:32.808586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710f994-0afe-4a21-bffa-745f2c0a0ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:32.809093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710f994-0afe-4a21-bffa-745f2c0a0ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:32.809570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710f994-0afe-4a21-bffa-745f2c0a0ed2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:32.818815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710f994-0afe-4a21-bffa-745f2c0a0ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:32.820601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710f994-0afe-4a21-bffa-745f2c0a0ed2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-1710f994-0afe-4a21-bffa-745f2c0a0ed2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:32.837538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:32.838887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:32.839841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:32.843115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 454/889] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:56:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:32.849473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710f994-0afe-4a21-bffa-745f2c0a0ed2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:32.854141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 436/890] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:32.879047 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f37e6-c1d5-4d8b-b238-a37f04283010 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:32.974756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710f994-0afe-4a21-bffa-745f2c0a0ed2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:32.993765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f37e6-c1d5-4d8b-b238-a37f04283010 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:33.018692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3833d-a777-42d0-a25f-5508e1da02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.019365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3833d-a777-42d0-a25f-5508e1da02f0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.019644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3833d-a777-42d0-a25f-5508e1da02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.019914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3833d-a777-42d0-a25f-5508e1da02f0 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.020747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3833d-a777-42d0-a25f-5508e1da02f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:33.021053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3833d-a777-42d0-a25f-5508e1da02f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.022515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3833d-a777-42d0-a25f-5508e1da02f0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.033486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093f40a-59f0-4ec5-909c-4ffd130d620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.034532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093f40a-59f0-4ec5-909c-4ffd130d620b None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.035051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093f40a-59f0-4ec5-909c-4ffd130d620b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.035542 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093f40a-59f0-4ec5-909c-4ffd130d620b None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.036469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093f40a-59f0-4ec5-909c-4ffd130d620b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.038884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093f40a-59f0-4ec5-909c-4ffd130d620b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.040542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 455/891] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 16 14:56:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:33.045765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3833d-a777-42d0-a25f-5508e1da02f0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:33.124854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 437/892] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:56:32 2022] POST /identity/v3/services => generated 241 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:56:33.126478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1af1a-05b3-4db1-957f-4fe4a7a291a9 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.126975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1af1a-05b3-4db1-957f-4fe4a7a291a9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.127447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1af1a-05b3-4db1-957f-4fe4a7a291a9 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.129322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 438/893] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:33.134782 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c63af-383b-41b8-b836-83b486273f98 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.135107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c63af-383b-41b8-b836-83b486273f98 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.135336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c63af-383b-41b8-b836-83b486273f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.154721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2c1c63af-383b-41b8-b836-83b486273f98 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:33.155949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2c1c63af-383b-41b8-b836-83b486273f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:33.160828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3833d-a777-42d0-a25f-5508e1da02f0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:33.216959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7e58-4659-41d5-a8b2-cd2c48515661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.218632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7e58-4659-41d5-a8b2-cd2c48515661 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.219395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7e58-4659-41d5-a8b2-cd2c48515661 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.219915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7e58-4659-41d5-a8b2-cd2c48515661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.238546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 439/894] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:33.253430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c63af-383b-41b8-b836-83b486273f98 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:33.307005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7e58-4659-41d5-a8b2-cd2c48515661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.308819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7e58-4659-41d5-a8b2-cd2c48515661 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.372121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c63af-383b-41b8-b836-83b486273f98 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:33.406682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eec74-c393-482e-8e00-3d83f5092812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.407580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eec74-c393-482e-8e00-3d83f5092812 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.407956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eec74-c393-482e-8e00-3d83f5092812 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.408301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eec74-c393-482e-8e00-3d83f5092812 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.409046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6eec74-c393-482e-8e00-3d83f5092812 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.410533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6eec74-c393-482e-8e00-3d83f5092812 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-bb6eec74-c393-482e-8e00-3d83f5092812 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:33.422286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:33.423325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:33.424144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 440/895] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:33.426092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 456/896] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:56:33.429606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eec74-c393-482e-8e00-3d83f5092812 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:33.434965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7e58-4659-41d5-a8b2-cd2c48515661 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:33.532489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7e58-4659-41d5-a8b2-cd2c48515661 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:33.532940 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eec74-c393-482e-8e00-3d83f5092812 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:33.566984 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33d83-5840-4633-b926-6ceba4871f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.567653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33d83-5840-4633-b926-6ceba4871f4f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.567933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33d83-5840-4633-b926-6ceba4871f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.568038 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620262ec-b185-4213-84ac-569a921e977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.568246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33d83-5840-4633-b926-6ceba4871f4f None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.568806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620262ec-b185-4213-84ac-569a921e977a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.568923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33d83-5840-4633-b926-6ceba4871f4f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:33.569077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620262ec-b185-4213-84ac-569a921e977a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.569179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33d83-5840-4633-b926-6ceba4871f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.569342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620262ec-b185-4213-84ac-569a921e977a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.570585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33d83-5840-4633-b926-6ceba4871f4f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.576172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 441/897] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:33.582360 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33d83-5840-4633-b926-6ceba4871f4f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:33.583510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620262ec-b185-4213-84ac-569a921e977a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.584972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620262ec-b185-4213-84ac-569a921e977a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-620262ec-b185-4213-84ac-569a921e977a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:33.603443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:33.604564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:33.606310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:33.606310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:33.606310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:33.606310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:33.614076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 457/898] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:33.614076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620262ec-b185-4213-84ac-569a921e977a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:33.685602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33d83-5840-4633-b926-6ceba4871f4f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:33.708852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620262ec-b185-4213-84ac-569a921e977a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:33.721723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17adb6b-61d4-4126-9354-a258f1cf168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.722514 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17adb6b-61d4-4126-9354-a258f1cf168e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.722897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17adb6b-61d4-4126-9354-a258f1cf168e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.723257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17adb6b-61d4-4126-9354-a258f1cf168e None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.724036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17adb6b-61d4-4126-9354-a258f1cf168e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:33.724410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17adb6b-61d4-4126-9354-a258f1cf168e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.725841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17adb6b-61d4-4126-9354-a258f1cf168e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.731183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 442/899] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:33.739960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17adb6b-61d4-4126-9354-a258f1cf168e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:33.749955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6275ef0-a95c-4167-8037-96211d2e06e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.750643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6275ef0-a95c-4167-8037-96211d2e06e4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.750929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6275ef0-a95c-4167-8037-96211d2e06e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.751192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6275ef0-a95c-4167-8037-96211d2e06e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.752464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6275ef0-a95c-4167-8037-96211d2e06e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:33.752765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6275ef0-a95c-4167-8037-96211d2e06e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.754160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6275ef0-a95c-4167-8037-96211d2e06e4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.769628 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 458/900] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:33.770569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6275ef0-a95c-4167-8037-96211d2e06e4 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:33.856039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17adb6b-61d4-4126-9354-a258f1cf168e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:33.873371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6275ef0-a95c-4167-8037-96211d2e06e4 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:33.891262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f303b45-9324-4417-aa26-382c988d28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.892341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f303b45-9324-4417-aa26-382c988d28b2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.892824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f303b45-9324-4417-aa26-382c988d28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.893294 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f303b45-9324-4417-aa26-382c988d28b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.894308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f303b45-9324-4417-aa26-382c988d28b2 None admin] RBAC: Adding query filter params (interface=public, service_id=2218f886f336489aa5cdf3638e538036, region_id=RegionOne) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:33.894826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f303b45-9324-4417-aa26-382c988d28b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.896407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f303b45-9324-4417-aa26-382c988d28b2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.908736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 443/901] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/endpoints?service_id=2218f886f336489aa5cdf3638e538036&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:33.911351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f303b45-9324-4417-aa26-382c988d28b2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:33.911833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef140-9982-4a81-8803-9281d9eeffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:33.912627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef140-9982-4a81-8803-9281d9eeffda None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:33.912905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef140-9982-4a81-8803-9281d9eeffda None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:33.913176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef140-9982-4a81-8803-9281d9eeffda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:33.920212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef140-9982-4a81-8803-9281d9eeffda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:33.921723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef140-9982-4a81-8803-9281d9eeffda None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-933ef140-9982-4a81-8803-9281d9eeffda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:33.936425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:33.937360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:33.938284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:33.938284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:33.938284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:33.938284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:33.938284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:33.938284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:33.938284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:33.938284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:33.938284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 459/902] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:33.943897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef140-9982-4a81-8803-9281d9eeffda None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:34.028170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f303b45-9324-4417-aa26-382c988d28b2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:34.043027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef140-9982-4a81-8803-9281d9eeffda None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:34.062644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f5ebd-084e-4082-9365-b31bbe220915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:34.063357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f5ebd-084e-4082-9365-b31bbe220915 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:34.063648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f5ebd-084e-4082-9365-b31bbe220915 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:34.064437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f5ebd-084e-4082-9365-b31bbe220915 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:34.065114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f5ebd-084e-4082-9365-b31bbe220915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:34.066506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f5ebd-084e-4082-9365-b31bbe220915 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:34.080473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 444/903] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 14:56:34.080473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ce180-4999-4eb5-af41-1405441f0216 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:34.080473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ce180-4999-4eb5-af41-1405441f0216 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:34.080473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ce180-4999-4eb5-af41-1405441f0216 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:34.080473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 445/904] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:34.086095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe428-4fcd-4f60-9ae6-fa1717104bda None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:34.086095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe428-4fcd-4f60-9ae6-fa1717104bda None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:34.086095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbe428-4fcd-4f60-9ae6-fa1717104bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:34.090828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a679b-5771-4804-8b90-812d9fe278f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:34.091512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a679b-5771-4804-8b90-812d9fe278f8 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:34.091791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a679b-5771-4804-8b90-812d9fe278f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:34.092058 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a679b-5771-4804-8b90-812d9fe278f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:34.092871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a679b-5771-4804-8b90-812d9fe278f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:34.093180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a679b-5771-4804-8b90-812d9fe278f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:34.094713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a679b-5771-4804-8b90-812d9fe278f8 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:34.108971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0dcbe428-4fcd-4f60-9ae6-fa1717104bda None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:34.110112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0dcbe428-4fcd-4f60-9ae6-fa1717104bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:34.121875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 460/905] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:34.123193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a679b-5771-4804-8b90-812d9fe278f8 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:34.186521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 446/906] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:34.205355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbe428-4fcd-4f60-9ae6-fa1717104bda None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:34.239981 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a679b-5771-4804-8b90-812d9fe278f8 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:34.287742 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db18e0b-463c-41d5-95c4-b2772ecafe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:34.288427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db18e0b-463c-41d5-95c4-b2772ecafe70 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:34.288694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db18e0b-463c-41d5-95c4-b2772ecafe70 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:34.288968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db18e0b-463c-41d5-95c4-b2772ecafe70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:34.289798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db18e0b-463c-41d5-95c4-b2772ecafe70 None admin] RBAC: Adding query filter params (role.id=b3cef2ee2fdd4f48872310e2d4f0cc22, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=8f9bad450f474e5a835d7c70b210e60e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:34.290942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db18e0b-463c-41d5-95c4-b2772ecafe70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:34.291635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db18e0b-463c-41d5-95c4-b2772ecafe70 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:34.299306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 461/907] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:34 2022] GET /identity/v3/role_assignments?user.id=8f9bad450f474e5a835d7c70b210e60e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=b3cef2ee2fdd4f48872310e2d4f0cc22 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:34.328091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbe428-4fcd-4f60-9ae6-fa1717104bda None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:34.367907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951098a-55ac-4a11-b10d-5fdc5805ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:34.368652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951098a-55ac-4a11-b10d-5fdc5805ead7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:34.368931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951098a-55ac-4a11-b10d-5fdc5805ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:34.369206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951098a-55ac-4a11-b10d-5fdc5805ead7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:34.369869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951098a-55ac-4a11-b10d-5fdc5805ead7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:34.371417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951098a-55ac-4a11-b10d-5fdc5805ead7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c951098a-55ac-4a11-b10d-5fdc5805ead7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:34.384821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:34.388050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:34.389527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 447/908] 10.222.0.44 () {56 vars in 1132 bytes} [Mon May 16 14:56:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:34.392964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db18e0b-463c-41d5-95c4-b2772ecafe70 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:34.501798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db18e0b-463c-41d5-95c4-b2772ecafe70 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:34.537476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e525f-d2bd-4c02-971d-15d652afdbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:34.538551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e525f-d2bd-4c02-971d-15d652afdbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:34.539032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e525f-d2bd-4c02-971d-15d652afdbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:34.539501 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e525f-d2bd-4c02-971d-15d652afdbf3 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:34.540392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e525f-d2bd-4c02-971d-15d652afdbf3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:34.540892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e525f-d2bd-4c02-971d-15d652afdbf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:34.542499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e525f-d2bd-4c02-971d-15d652afdbf3 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:34.547690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 462/909] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:34.554008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951098a-55ac-4a11-b10d-5fdc5805ead7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:34.655747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951098a-55ac-4a11-b10d-5fdc5805ead7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:34.689874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea35b4a-b327-4d89-99f1-1cd03fe12f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:34.690894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35b4a-b327-4d89-99f1-1cd03fe12f5e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:34.691351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35b4a-b327-4d89-99f1-1cd03fe12f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:34.691795 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35b4a-b327-4d89-99f1-1cd03fe12f5e None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:34.692675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea35b4a-b327-4d89-99f1-1cd03fe12f5e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:34.693149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea35b4a-b327-4d89-99f1-1cd03fe12f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:34.694710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea35b4a-b327-4d89-99f1-1cd03fe12f5e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:34.700023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 448/910] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:34.705967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e525f-d2bd-4c02-971d-15d652afdbf3 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:34.814941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e525f-d2bd-4c02-971d-15d652afdbf3 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:34.849550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e61c8-b03e-4ceb-8180-97bfca23057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:34.850239 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e61c8-b03e-4ceb-8180-97bfca23057d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:34.850518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e61c8-b03e-4ceb-8180-97bfca23057d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:34.850790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e61c8-b03e-4ceb-8180-97bfca23057d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:34.851580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e61c8-b03e-4ceb-8180-97bfca23057d None admin] RBAC: Adding query filter params (interface=public, service_id=a118fed6bbb5484f92b962fd80789b66, region_id=RegionOne) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:34.851887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e61c8-b03e-4ceb-8180-97bfca23057d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:34.853244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e61c8-b03e-4ceb-8180-97bfca23057d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:34.858828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 463/911] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 16 14:56:34 2022] GET /identity/v3/endpoints?service_id=a118fed6bbb5484f92b962fd80789b66&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:34.865013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea35b4a-b327-4d89-99f1-1cd03fe12f5e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:34.966948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea35b4a-b327-4d89-99f1-1cd03fe12f5e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:35.001667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acda303-47e1-4925-a06e-cd69a4b02c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:35.002760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda303-47e1-4925-a06e-cd69a4b02c71 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:35.003314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda303-47e1-4925-a06e-cd69a4b02c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:35.003790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda303-47e1-4925-a06e-cd69a4b02c71 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:35.004713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acda303-47e1-4925-a06e-cd69a4b02c71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:35.006291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acda303-47e1-4925-a06e-cd69a4b02c71 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:35.012935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 449/912] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 16 14:56:34 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 14:56:35.461459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33403abd-fcd9-41af-ad43-b8b5a962cce2 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:35.461850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33403abd-fcd9-41af-ad43-b8b5a962cce2 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:35.462025 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33403abd-fcd9-41af-ad43-b8b5a962cce2 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:35.463939 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 464/913] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:35.469440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836ac0-313b-4e6a-b3c2-67f3802c40bc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:35.469871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836ac0-313b-4e6a-b3c2-67f3802c40bc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:35.470037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836ac0-313b-4e6a-b3c2-67f3802c40bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:35.487604 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fe836ac0-313b-4e6a-b3c2-67f3802c40bc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:35.488773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fe836ac0-313b-4e6a-b3c2-67f3802c40bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:35.554046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 450/914] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:35.576098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33403abd-fcd9-41af-ad43-b8b5a962cce2 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:35.677213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33403abd-fcd9-41af-ad43-b8b5a962cce2 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:35.709838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5f6d-241e-468a-a00c-3897284b4545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:35.710667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5f6d-241e-468a-a00c-3897284b4545 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:35.710999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5f6d-241e-468a-a00c-3897284b4545 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:35.711270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5f6d-241e-468a-a00c-3897284b4545 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:35.712030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5f6d-241e-468a-a00c-3897284b4545 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:35.713592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5f6d-241e-468a-a00c-3897284b4545 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-124c5f6d-241e-468a-a00c-3897284b4545 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:35.726362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:35.727352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:35.728193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:35.732613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 465/915] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:35.735131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836ac0-313b-4e6a-b3c2-67f3802c40bc None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:35.833841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836ac0-313b-4e6a-b3c2-67f3802c40bc None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:35.869387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14504cc-5c2b-460a-9021-0f29531c2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:35.870378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14504cc-5c2b-460a-9021-0f29531c2db2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:35.870842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14504cc-5c2b-460a-9021-0f29531c2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:35.871294 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14504cc-5c2b-460a-9021-0f29531c2db2 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:35.872230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14504cc-5c2b-460a-9021-0f29531c2db2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:35.872723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14504cc-5c2b-460a-9021-0f29531c2db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:35.874371 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14504cc-5c2b-460a-9021-0f29531c2db2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:35.883460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 451/916] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:35.885904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5f6d-241e-468a-a00c-3897284b4545 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:35.985955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5f6d-241e-468a-a00c-3897284b4545 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:36.019630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cc91-c0a1-45e1-bbed-b86328306ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:36.020593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cc91-c0a1-45e1-bbed-b86328306ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.021079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cc91-c0a1-45e1-bbed-b86328306ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.021540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cc91-c0a1-45e1-bbed-b86328306ab2 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.022468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cc91-c0a1-45e1-bbed-b86328306ab2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:36.022956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cc91-c0a1-45e1-bbed-b86328306ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:36.024494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cc91-c0a1-45e1-bbed-b86328306ab2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:36.034170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 466/917] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:36.036900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14504cc-5c2b-460a-9021-0f29531c2db2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:36.140682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14504cc-5c2b-460a-9021-0f29531c2db2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:36.180593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa840b-c6d0-465f-9aed-a938caa37001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:36.181260 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa840b-c6d0-465f-9aed-a938caa37001 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.181539 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa840b-c6d0-465f-9aed-a938caa37001 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.181808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa840b-c6d0-465f-9aed-a938caa37001 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.182629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa840b-c6d0-465f-9aed-a938caa37001 None admin] RBAC: Adding query filter params (interface=public, service_id=ee63169522704beb9202fbc0f81b6ec0, region_id=RegionOne) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:36.182937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa840b-c6d0-465f-9aed-a938caa37001 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:36.184315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa840b-c6d0-465f-9aed-a938caa37001 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:36.194206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 452/918] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 16 14:56:36 2022] GET /identity/v3/endpoints?service_id=ee63169522704beb9202fbc0f81b6ec0&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:36.196435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cc91-c0a1-45e1-bbed-b86328306ab2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:36.300766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cc91-c0a1-45e1-bbed-b86328306ab2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:36.334698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0443c77-72ee-4830-be91-fdc6d0915044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:36.335366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0443c77-72ee-4830-be91-fdc6d0915044 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.335647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0443c77-72ee-4830-be91-fdc6d0915044 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.335922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0443c77-72ee-4830-be91-fdc6d0915044 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.336604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0443c77-72ee-4830-be91-fdc6d0915044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:36.337970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0443c77-72ee-4830-be91-fdc6d0915044 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:36.348642 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 467/919] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 16 14:56:36 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 14:56:36.394561 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76108-b2c9-4fd3-a1b1-e4df6b9d2c86 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.394931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76108-b2c9-4fd3-a1b1-e4df6b9d2c86 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.395116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76108-b2c9-4fd3-a1b1-e4df6b9d2c86 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.396867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 453/920] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:36.402886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e16cc1-a504-4d14-8389-e28f36658d4e None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.403194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e16cc1-a504-4d14-8389-e28f36658d4e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.403431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e16cc1-a504-4d14-8389-e28f36658d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.422301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-39e16cc1-a504-4d14-8389-e28f36658d4e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:36.423647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-39e16cc1-a504-4d14-8389-e28f36658d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:36.497834 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 468/921] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:36.520993 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76108-b2c9-4fd3-a1b1-e4df6b9d2c86 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:36.586578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2690fa-f23f-43ca-9677-a20f3643a974 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.587411 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2690fa-f23f-43ca-9677-a20f3643a974 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.587688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2690fa-f23f-43ca-9677-a20f3643a974 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.589315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 469/922] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:36.594636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9c8a8-44f8-48d1-aaa1-474bb1e4f168 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.594920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9c8a8-44f8-48d1-aaa1-474bb1e4f168 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.595229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9c8a8-44f8-48d1-aaa1-474bb1e4f168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.611897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-26a9c8a8-44f8-48d1-aaa1-474bb1e4f168 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:36.613057 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-26a9c8a8-44f8-48d1-aaa1-474bb1e4f168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:36.638255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76108-b2c9-4fd3-a1b1-e4df6b9d2c86 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:36.682648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 470/923] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:36.686075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042bd61-c588-4473-912b-b2c114f29103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:36.686075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042bd61-c588-4473-912b-b2c114f29103 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.686075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042bd61-c588-4473-912b-b2c114f29103 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.686075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042bd61-c588-4473-912b-b2c114f29103 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.686397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042bd61-c588-4473-912b-b2c114f29103 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:36.687067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042bd61-c588-4473-912b-b2c114f29103 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-8042bd61-c588-4473-912b-b2c114f29103 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:36.699706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:36.700756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:36.702374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 454/924] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:56:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:36.707162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9c8a8-44f8-48d1-aaa1-474bb1e4f168 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:36.708438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042bd61-c588-4473-912b-b2c114f29103 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:36.823667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9c8a8-44f8-48d1-aaa1-474bb1e4f168 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:36.826808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042bd61-c588-4473-912b-b2c114f29103 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:36.859626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354242e7-6173-424b-bbea-1e9876a12c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:36.861297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354242e7-6173-424b-bbea-1e9876a12c0e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.861907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354242e7-6173-424b-bbea-1e9876a12c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.862451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354242e7-6173-424b-bbea-1e9876a12c0e None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.863405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354242e7-6173-424b-bbea-1e9876a12c0e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:36.863617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0eb90-2a97-4d6b-9e2d-a5f26b68d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:36.864072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354242e7-6173-424b-bbea-1e9876a12c0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:36.864503 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0eb90-2a97-4d6b-9e2d-a5f26b68d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:36.864885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0eb90-2a97-4d6b-9e2d-a5f26b68d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:36.865268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0eb90-2a97-4d6b-9e2d-a5f26b68d3d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:36.866342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354242e7-6173-424b-bbea-1e9876a12c0e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:36.871874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 471/925] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:56:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:36.877520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354242e7-6173-424b-bbea-1e9876a12c0e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:36.882240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0eb90-2a97-4d6b-9e2d-a5f26b68d3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-a1c0eb90-2a97-4d6b-9e2d-a5f26b68d3d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:36.891902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:36.893382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:36.894622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:36.897037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 455/926] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 16 14:56:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:36.904169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0eb90-2a97-4d6b-9e2d-a5f26b68d3d1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:36.986429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354242e7-6173-424b-bbea-1e9876a12c0e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:37.027950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0eb90-2a97-4d6b-9e2d-a5f26b68d3d1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:37.031934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7e7e-520b-4b6f-ad60-85b9687fcb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:37.032606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7e7e-520b-4b6f-ad60-85b9687fcb9b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.032920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7e7e-520b-4b6f-ad60-85b9687fcb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.033197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7e7e-520b-4b6f-ad60-85b9687fcb9b None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.033907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7e7e-520b-4b6f-ad60-85b9687fcb9b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:37.034259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7e7e-520b-4b6f-ad60-85b9687fcb9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:37.035626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7e7e-520b-4b6f-ad60-85b9687fcb9b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:37.046356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 472/927] 10.222.0.44 () {56 vars in 1114 bytes} [Mon May 16 14:56:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:37.047875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7e7e-520b-4b6f-ad60-85b9687fcb9b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:37.071307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9df6d-1627-43fe-bc6c-9fd1b98f8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:37.071978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9df6d-1627-43fe-bc6c-9fd1b98f8c41 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.072262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9df6d-1627-43fe-bc6c-9fd1b98f8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.072592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9df6d-1627-43fe-bc6c-9fd1b98f8c41 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.073353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9df6d-1627-43fe-bc6c-9fd1b98f8c41 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:37.074182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9df6d-1627-43fe-bc6c-9fd1b98f8c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:37.075941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9df6d-1627-43fe-bc6c-9fd1b98f8c41 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:37.098161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 456/928] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 16 14:56:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:37.101329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9df6d-1627-43fe-bc6c-9fd1b98f8c41 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:37.179885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7e7e-520b-4b6f-ad60-85b9687fcb9b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:37.218744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766afcc1-983d-4b85-b489-1bd3e9207d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:37.219756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766afcc1-983d-4b85-b489-1bd3e9207d38 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.220794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766afcc1-983d-4b85-b489-1bd3e9207d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.221269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766afcc1-983d-4b85-b489-1bd3e9207d38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.222261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766afcc1-983d-4b85-b489-1bd3e9207d38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:37.223820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766afcc1-983d-4b85-b489-1bd3e9207d38 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:37.223999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9df6d-1627-43fe-bc6c-9fd1b98f8c41 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:37.259638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0497180-f4bb-4b10-a62d-76624c77da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:37.260453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0497180-f4bb-4b10-a62d-76624c77da1c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.260736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0497180-f4bb-4b10-a62d-76624c77da1c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.261009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0497180-f4bb-4b10-a62d-76624c77da1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.271482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0497180-f4bb-4b10-a62d-76624c77da1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:37.272991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0497180-f4bb-4b10-a62d-76624c77da1c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f0497180-f4bb-4b10-a62d-76624c77da1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:37.290305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:37.291283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:37.292164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:37.292164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:37.292164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:37.292164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:37.292164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 457/929] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:37.292836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63b1f-4e53-4347-a772-9e16fd9ac38d None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.293133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63b1f-4e53-4347-a772-9e16fd9ac38d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.293428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e63b1f-4e53-4347-a772-9e16fd9ac38d None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.294816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 458/930] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:37.296903 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e63b1f-4e53-4347-a772-9e16fd9ac38d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:37.326492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 473/931] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 16 14:56:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:37.327979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d58033-47d0-4aac-a046-ca6dd25b9a5e None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.328271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d58033-47d0-4aac-a046-ca6dd25b9a5e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.328548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d58033-47d0-4aac-a046-ca6dd25b9a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.371773 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c4d58033-47d0-4aac-a046-ca6dd25b9a5e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:37.373006 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c4d58033-47d0-4aac-a046-ca6dd25b9a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:37.420983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e63b1f-4e53-4347-a772-9e16fd9ac38d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:37.452739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 474/932] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:37.464441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85acdc1-a79c-495e-9043-1e1b9c408761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:37.465493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85acdc1-a79c-495e-9043-1e1b9c408761 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.465974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85acdc1-a79c-495e-9043-1e1b9c408761 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.466610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85acdc1-a79c-495e-9043-1e1b9c408761 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.467577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85acdc1-a79c-495e-9043-1e1b9c408761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:37.468116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85acdc1-a79c-495e-9043-1e1b9c408761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:37.469707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85acdc1-a79c-495e-9043-1e1b9c408761 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:37.478320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d58033-47d0-4aac-a046-ca6dd25b9a5e None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:37.484901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 459/933] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:37.492555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85acdc1-a79c-495e-9043-1e1b9c408761 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:37.610173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d58033-47d0-4aac-a046-ca6dd25b9a5e None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:37.617221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85acdc1-a79c-495e-9043-1e1b9c408761 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:37.651960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb43956-dd78-414c-9f84-914dc1b6cc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:37.652819 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb43956-dd78-414c-9f84-914dc1b6cc7d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.653112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb43956-dd78-414c-9f84-914dc1b6cc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.653419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb43956-dd78-414c-9f84-914dc1b6cc7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.654283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db1ced-0e42-467f-8c44-b7496cdfdc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:37.655464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db1ced-0e42-467f-8c44-b7496cdfdc58 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.655956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db1ced-0e42-467f-8c44-b7496cdfdc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.656932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db1ced-0e42-467f-8c44-b7496cdfdc58 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.657816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db1ced-0e42-467f-8c44-b7496cdfdc58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:37.659402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db1ced-0e42-467f-8c44-b7496cdfdc58 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:37.661061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb43956-dd78-414c-9f84-914dc1b6cc7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:37.663005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb43956-dd78-414c-9f84-914dc1b6cc7d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-23db1ced-0e42-467f-8c44-b7496cdfdc58 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:37.674030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:37.675016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 14:56:37.675851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2fb43956-dd78-414c-9f84-914dc1b6cc7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:37.679634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:37.680538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:37.681540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 460/935] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:56:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:37.682604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 475/934] 10.222.0.44 () {56 vars in 1132 bytes} [Mon May 16 14:56:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:37.688949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb43956-dd78-414c-9f84-914dc1b6cc7d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:37.690707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db1ced-0e42-467f-8c44-b7496cdfdc58 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:37.811594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb43956-dd78-414c-9f84-914dc1b6cc7d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:37.813049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db1ced-0e42-467f-8c44-b7496cdfdc58 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:37.848248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120474-679c-4d8d-8bd2-459e14a075a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:37.848922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120474-679c-4d8d-8bd2-459e14a075a4 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.849198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120474-679c-4d8d-8bd2-459e14a075a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.849470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120474-679c-4d8d-8bd2-459e14a075a4 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.850530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65120474-679c-4d8d-8bd2-459e14a075a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:37.850845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65120474-679c-4d8d-8bd2-459e14a075a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:37.852023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86833e32-41d3-44ad-8a79-0ef518668b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:37.852272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65120474-679c-4d8d-8bd2-459e14a075a4 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:37.853086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833e32-41d3-44ad-8a79-0ef518668b59 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:37.853558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833e32-41d3-44ad-8a79-0ef518668b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:37.854019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833e32-41d3-44ad-8a79-0ef518668b59 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:37.854884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86833e32-41d3-44ad-8a79-0ef518668b59 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:37.855204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86833e32-41d3-44ad-8a79-0ef518668b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:37.856566 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86833e32-41d3-44ad-8a79-0ef518668b59 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:37.864063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 461/936] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:37.869537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86833e32-41d3-44ad-8a79-0ef518668b59 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:37.879094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 476/937] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 16 14:56:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:37.880708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120474-679c-4d8d-8bd2-459e14a075a4 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:37.982122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120474-679c-4d8d-8bd2-459e14a075a4 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:38.022610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ba0f4-7da8-4271-8396-565ba2d76d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:38.023431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ba0f4-7da8-4271-8396-565ba2d76d57 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:38.023712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ba0f4-7da8-4271-8396-565ba2d76d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:38.023986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ba0f4-7da8-4271-8396-565ba2d76d57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:38.034725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ba0f4-7da8-4271-8396-565ba2d76d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:38.036182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ba0f4-7da8-4271-8396-565ba2d76d57 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-a93ba0f4-7da8-4271-8396-565ba2d76d57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:38.054388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:38.055341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:38.056233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:38.056233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:38.056233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:38.056233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:38.060486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 477/938] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:38.063300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ba0f4-7da8-4271-8396-565ba2d76d57 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:38.129837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86833e32-41d3-44ad-8a79-0ef518668b59 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:38.202455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001d561-c02c-45fa-b65e-d5116618b33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:38.205233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001d561-c02c-45fa-b65e-d5116618b33c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:38.206346 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ba0f4-7da8-4271-8396-565ba2d76d57 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:38.208027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001d561-c02c-45fa-b65e-d5116618b33c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:38.208471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001d561-c02c-45fa-b65e-d5116618b33c None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:38.210316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001d561-c02c-45fa-b65e-d5116618b33c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:38.212170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001d561-c02c-45fa-b65e-d5116618b33c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:38.213985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001d561-c02c-45fa-b65e-d5116618b33c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:38.232158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 462/939] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:38.238393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001d561-c02c-45fa-b65e-d5116618b33c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:38.249554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cacf6a-8e53-4f13-935d-62db5fc66658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:38.250685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cacf6a-8e53-4f13-935d-62db5fc66658 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:38.250685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cacf6a-8e53-4f13-935d-62db5fc66658 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:38.251135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cacf6a-8e53-4f13-935d-62db5fc66658 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:38.252033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cacf6a-8e53-4f13-935d-62db5fc66658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:38.252630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cacf6a-8e53-4f13-935d-62db5fc66658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:38.253985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cacf6a-8e53-4f13-935d-62db5fc66658 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:38.270943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 478/940] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:38.272012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cacf6a-8e53-4f13-935d-62db5fc66658 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:38.339732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001d561-c02c-45fa-b65e-d5116618b33c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:38.372046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cacf6a-8e53-4f13-935d-62db5fc66658 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:38.374002 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760902e5-2b17-4593-b7af-96804645c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:38.374859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760902e5-2b17-4593-b7af-96804645c8c7 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:38.375313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760902e5-2b17-4593-b7af-96804645c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:38.375780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760902e5-2b17-4593-b7af-96804645c8c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:38.377281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760902e5-2b17-4593-b7af-96804645c8c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:38.378848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760902e5-2b17-4593-b7af-96804645c8c7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:38.407733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106889a-d458-488e-b954-c29b6728913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:38.408607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106889a-d458-488e-b954-c29b6728913c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:38.408894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106889a-d458-488e-b954-c29b6728913c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:38.409265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106889a-d458-488e-b954-c29b6728913c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:38.416075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106889a-d458-488e-b954-c29b6728913c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:38.417671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106889a-d458-488e-b954-c29b6728913c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-f106889a-d458-488e-b954-c29b6728913c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:38.432431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:38.433301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:38.434648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:38.434648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:38.434648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:38.434648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:38.434648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:38.434648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:38.434648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:38.434648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:38.435251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 479/941] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:38.440005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106889a-d458-488e-b954-c29b6728913c None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:38.458199 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 463/942] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 16 14:56:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:38.557496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106889a-d458-488e-b954-c29b6728913c None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:38.602814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f7e0a-5695-4070-b6a3-66cc78a6bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:38.603399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f7e0a-5695-4070-b6a3-66cc78a6bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:38.603677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f7e0a-5695-4070-b6a3-66cc78a6bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:38.603948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f7e0a-5695-4070-b6a3-66cc78a6bbb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:38.604736 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f7e0a-5695-4070-b6a3-66cc78a6bbb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:38.605046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f7e0a-5695-4070-b6a3-66cc78a6bbb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:38.606531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f7e0a-5695-4070-b6a3-66cc78a6bbb5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:38.620357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 480/943] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:38.626107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760902e5-2b17-4593-b7af-96804645c8c7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:38.730852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760902e5-2b17-4593-b7af-96804645c8c7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:38.742948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49becd49-5a95-4e6e-bda0-5a9be53c7255 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:38.743238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49becd49-5a95-4e6e-bda0-5a9be53c7255 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:38.743514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49becd49-5a95-4e6e-bda0-5a9be53c7255 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:38.745135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 481/944] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:38.750217 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856b82-5d59-4ce1-99cc-340292f841ce None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:38.750503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856b82-5d59-4ce1-99cc-340292f841ce None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:38.750778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856b82-5d59-4ce1-99cc-340292f841ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:38.766584 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f63e-fc44-4365-827d-7f586034b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:38.767786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f63e-fc44-4365-827d-7f586034b563 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:38.768213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-29856b82-5d59-4ce1-99cc-340292f841ce None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:38.768425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f63e-fc44-4365-827d-7f586034b563 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:38.768913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f63e-fc44-4365-827d-7f586034b563 None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/8f9bad450f474e5a835d7c70b210e60e/roles/b3cef2ee2fdd4f48872310e2d4f0cc22` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:38.769397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-29856b82-5d59-4ce1-99cc-340292f841ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:38.771591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918f63e-fc44-4365-827d-7f586034b563 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=8f9bad450f474e5a835d7c70b210e60e, role_id=b3cef2ee2fdd4f48872310e2d4f0cc22)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:38.773195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918f63e-fc44-4365-827d-7f586034b563 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:38.838115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 482/945] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:38.846382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 464/946] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:38 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/8f9bad450f474e5a835d7c70b210e60e/roles/b3cef2ee2fdd4f48872310e2d4f0cc22 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:56:38.867551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856b82-5d59-4ce1-99cc-340292f841ce None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:38.977127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856b82-5d59-4ce1-99cc-340292f841ce None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:39.013837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311037d7-733c-46fb-8aa9-38637c15c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:39.014718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311037d7-733c-46fb-8aa9-38637c15c233 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:39.015005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311037d7-733c-46fb-8aa9-38637c15c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:39.015273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311037d7-733c-46fb-8aa9-38637c15c233 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:39.015944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311037d7-733c-46fb-8aa9-38637c15c233 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:39.017901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311037d7-733c-46fb-8aa9-38637c15c233 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-311037d7-733c-46fb-8aa9-38637c15c233 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:39.030725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:39.031938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:39.033372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 483/947] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:39.040669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f63e-fc44-4365-827d-7f586034b563 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:39.147447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f63e-fc44-4365-827d-7f586034b563 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:39.181501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fd1a4-f05f-4d52-9bfc-d41d98df5db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:39.182698 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fd1a4-f05f-4d52-9bfc-d41d98df5db3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:39.183179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fd1a4-f05f-4d52-9bfc-d41d98df5db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:39.183646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fd1a4-f05f-4d52-9bfc-d41d98df5db3 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:39.184558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fd1a4-f05f-4d52-9bfc-d41d98df5db3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:39.185057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fd1a4-f05f-4d52-9bfc-d41d98df5db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:39.186658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fd1a4-f05f-4d52-9bfc-d41d98df5db3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:39.192647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 465/948] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:39.199454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311037d7-733c-46fb-8aa9-38637c15c233 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:39.302798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311037d7-733c-46fb-8aa9-38637c15c233 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:39.337960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9e659-0dcd-469a-8e9d-d7cc8ea29b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:39.338996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9e659-0dcd-469a-8e9d-d7cc8ea29b2f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:39.339281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9e659-0dcd-469a-8e9d-d7cc8ea29b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:39.339556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9e659-0dcd-469a-8e9d-d7cc8ea29b2f None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:39.340287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9e659-0dcd-469a-8e9d-d7cc8ea29b2f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:39.340664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9e659-0dcd-469a-8e9d-d7cc8ea29b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:39.342037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9e659-0dcd-469a-8e9d-d7cc8ea29b2f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:39.347570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 484/949] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:39.352820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fd1a4-f05f-4d52-9bfc-d41d98df5db3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:39.462651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fd1a4-f05f-4d52-9bfc-d41d98df5db3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:39.495624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8300d66-7f61-44d0-80b2-030f7c414764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:39.496585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300d66-7f61-44d0-80b2-030f7c414764 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:39.497067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300d66-7f61-44d0-80b2-030f7c414764 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:39.497536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300d66-7f61-44d0-80b2-030f7c414764 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:39.498520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8300d66-7f61-44d0-80b2-030f7c414764 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:39.500093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8300d66-7f61-44d0-80b2-030f7c414764 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:39.581836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 466/950] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 16 14:56:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:39.714069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51181-88d4-4573-b147-10163a608b73 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:39.714570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51181-88d4-4573-b147-10163a608b73 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:39.714570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f51181-88d4-4573-b147-10163a608b73 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:39.716288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 485/951] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:39.722798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682b62-741d-4e81-8f03-d20e7964d618 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:39.723343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682b62-741d-4e81-8f03-d20e7964d618 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:39.723343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682b62-741d-4e81-8f03-d20e7964d618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:39.740971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f7682b62-741d-4e81-8f03-d20e7964d618 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:39.742222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f7682b62-741d-4e81-8f03-d20e7964d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:39.822165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 467/952] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:39.841330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51181-88d4-4573-b147-10163a608b73 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:39.941252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f51181-88d4-4573-b147-10163a608b73 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:39.979302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:39.979889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:39.980171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:39.980442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:39.981216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:39.982681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:39.984051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WARNING keystone.server.flask.common [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 14:56:40.044703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.sql.core [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 14:56:40.044703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 14:56:40.044703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [parameters: {'id': '0a210a0a75414959b218b6ac35cbd2e8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 14:56:40.044703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80179) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a210a0a75414959b218b6ac35cbd2e8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a210a0a75414959b218b6ac35cbd2e8. May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application conn.query(q) May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:56:40.052986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application result.read() May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 14:56:40.053772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application next(self.gen) May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application yield resource May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application next(self.gen) May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.session.rollback() May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.force_reraise() May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise self.value May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application session.commit() May 16 14:56:40.054743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._prepare_impl() May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.session.flush() May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._flush(objects) May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application compat.raise_( May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application flush_context.execute() May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 14:56:40.055639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rec.execute(self) May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 14:56:40.057970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application conn.query(q) May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application result.read() May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:56:40.059815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [parameters: {'id': '0a210a0a75414959b218b6ac35cbd2e8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:40.061790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:40.063469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a210a0a75414959b218b6ac35cbd2e8. May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:40.065140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 486/953] 10.222.0.44 () {60 vars in 1140 bytes} [Mon May 16 14:56:39 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:40.065802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682b62-741d-4e81-8f03-d20e7964d618 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:40.171022 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682b62-741d-4e81-8f03-d20e7964d618 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:40.205526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a9f13-b3c5-440a-87d7-113379276be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:40.206771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a9f13-b3c5-440a-87d7-113379276be1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:40.207308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a9f13-b3c5-440a-87d7-113379276be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:40.207803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a9f13-b3c5-440a-87d7-113379276be1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:40.215111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a9f13-b3c5-440a-87d7-113379276be1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:40.216841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a9f13-b3c5-440a-87d7-113379276be1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e20a9f13-b3c5-440a-87d7-113379276be1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:40.231198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:40.232083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:40.232968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:40.232968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:40.232968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:40.232968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:40.232968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:40.232968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:40.232968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:40.232968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:40.240398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 468/954] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:40.242252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:40.341582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f2cec-dbb0-4233-ac61-bfef13afdaa1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:40.375551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8ae3f-e8cd-4b59-a89a-37ed643529a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:40.376680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8ae3f-e8cd-4b59-a89a-37ed643529a2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:40.377170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8ae3f-e8cd-4b59-a89a-37ed643529a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:40.377644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8ae3f-e8cd-4b59-a89a-37ed643529a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:40.378621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8ae3f-e8cd-4b59-a89a-37ed643529a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:40.379132 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8ae3f-e8cd-4b59-a89a-37ed643529a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:40.380979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8ae3f-e8cd-4b59-a89a-37ed643529a2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:40.406186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 487/955] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:40.802939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ce83-e468-4cdc-a0a4-ea3489b38949 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:40.803458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ce83-e468-4cdc-a0a4-ea3489b38949 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:40.803458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ce83-e468-4cdc-a0a4-ea3489b38949 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:40.805059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 469/956] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:40.810586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb38e02-06c2-4aa5-a43a-af5d8d6fbbee None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:40.811010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb38e02-06c2-4aa5-a43a-af5d8d6fbbee None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:40.811189 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb38e02-06c2-4aa5-a43a-af5d8d6fbbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:40.831946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9bb38e02-06c2-4aa5-a43a-af5d8d6fbbee None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:40.833461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9bb38e02-06c2-4aa5-a43a-af5d8d6fbbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:40.900875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 488/957] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:40.922108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ce83-e468-4cdc-a0a4-ea3489b38949 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:41.028858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ce83-e468-4cdc-a0a4-ea3489b38949 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:41.062237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a415-1962-4238-8c9a-cf2a291860c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:41.062945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a415-1962-4238-8c9a-cf2a291860c4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.063227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a415-1962-4238-8c9a-cf2a291860c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.063497 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a415-1962-4238-8c9a-cf2a291860c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.064777 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6a415-1962-4238-8c9a-cf2a291860c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:41.066152 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6a415-1962-4238-8c9a-cf2a291860c4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b5c6a415-1962-4238-8c9a-cf2a291860c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:41.077806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:41.078816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:41.080840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 470/958] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:41.085344 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb38e02-06c2-4aa5-a43a-af5d8d6fbbee None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:41.163213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ba5e-9e49-4e55-a7dd-a7043440c436 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.163510 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ba5e-9e49-4e55-a7dd-a7043440c436 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.163763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8ba5e-9e49-4e55-a7dd-a7043440c436 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.165360 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 471/959] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:41.171129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a890f1-7e3a-461e-b883-695ab2128e71 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.171519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a890f1-7e3a-461e-b883-695ab2128e71 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.171894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a890f1-7e3a-461e-b883-695ab2128e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.184518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb38e02-06c2-4aa5-a43a-af5d8d6fbbee None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:41.189723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-31a890f1-7e3a-461e-b883-695ab2128e71 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:41.191030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-31a890f1-7e3a-461e-b883-695ab2128e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:41.218720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faafa0c-5a88-4e77-a7b2-621e48251dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:41.219380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faafa0c-5a88-4e77-a7b2-621e48251dec None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.219661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faafa0c-5a88-4e77-a7b2-621e48251dec None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.219931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faafa0c-5a88-4e77-a7b2-621e48251dec None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.220662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faafa0c-5a88-4e77-a7b2-621e48251dec None admin] RBAC: Adding query filter params (name=compute) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:41.220963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faafa0c-5a88-4e77-a7b2-621e48251dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:41.222343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faafa0c-5a88-4e77-a7b2-621e48251dec None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:41.227504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 489/960] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:41.232646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faafa0c-5a88-4e77-a7b2-621e48251dec None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:41.278076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 472/961] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:41.294202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a890f1-7e3a-461e-b883-695ab2128e71 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:41.355590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faafa0c-5a88-4e77-a7b2-621e48251dec None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:41.397778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec57648-bf21-479d-8268-8e8a2fc9676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:41.398796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec57648-bf21-479d-8268-8e8a2fc9676f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.399314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec57648-bf21-479d-8268-8e8a2fc9676f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.399769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec57648-bf21-479d-8268-8e8a2fc9676f None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.401057 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec57648-bf21-479d-8268-8e8a2fc9676f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:41.401537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec57648-bf21-479d-8268-8e8a2fc9676f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:41.403500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec57648-bf21-479d-8268-8e8a2fc9676f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:41.418087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 490/962] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:41.421866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a890f1-7e3a-461e-b883-695ab2128e71 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:41.459986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4167f-4b04-4e43-a90e-f13bab60c74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:41.460816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4167f-4b04-4e43-a90e-f13bab60c74b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.461096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4167f-4b04-4e43-a90e-f13bab60c74b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.461365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4167f-4b04-4e43-a90e-f13bab60c74b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.473300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4167f-4b04-4e43-a90e-f13bab60c74b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c7f4167f-4b04-4e43-a90e-f13bab60c74b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:41.481715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:41.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:41.483600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 473/963] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 16 14:56:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:41.495331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec57648-bf21-479d-8268-8e8a2fc9676f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:41.602531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec57648-bf21-479d-8268-8e8a2fc9676f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:41.641579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893cd97-0837-49fd-9dfc-ce691a2a5969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:41.642841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893cd97-0837-49fd-9dfc-ce691a2a5969 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.643120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893cd97-0837-49fd-9dfc-ce691a2a5969 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.643391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893cd97-0837-49fd-9dfc-ce691a2a5969 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.644142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893cd97-0837-49fd-9dfc-ce691a2a5969 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:41.644445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893cd97-0837-49fd-9dfc-ce691a2a5969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:41.645816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893cd97-0837-49fd-9dfc-ce691a2a5969 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:41.654568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 491/964] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 16 14:56:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:41.660256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4167f-4b04-4e43-a90e-f13bab60c74b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:41.766262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4167f-4b04-4e43-a90e-f13bab60c74b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:41.801918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5720aad-b8b5-4579-b463-08fc86d28c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:41.802744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720aad-b8b5-4579-b463-08fc86d28c6e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.803026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720aad-b8b5-4579-b463-08fc86d28c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.803546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720aad-b8b5-4579-b463-08fc86d28c6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.814755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5720aad-b8b5-4579-b463-08fc86d28c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:41.816265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5720aad-b8b5-4579-b463-08fc86d28c6e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b5720aad-b8b5-4579-b463-08fc86d28c6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:41.833568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:41.834570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:41.835473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:41.835473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:41.835473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:41.835473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:41.835473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 474/965] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:41.842118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893cd97-0837-49fd-9dfc-ce691a2a5969 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:41.933232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bf2a4-14cc-46a7-9a63-3902467a5640 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.933535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bf2a4-14cc-46a7-9a63-3902467a5640 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.933724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bf2a4-14cc-46a7-9a63-3902467a5640 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.935333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 475/966] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:41.942421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93783e-19f0-4e06-b7c6-2e40a27f26e2 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.942421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93783e-19f0-4e06-b7c6-2e40a27f26e2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.942421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93783e-19f0-4e06-b7c6-2e40a27f26e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.945192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893cd97-0837-49fd-9dfc-ce691a2a5969 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:41.962176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8d93783e-19f0-4e06-b7c6-2e40a27f26e2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:41.964273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8d93783e-19f0-4e06-b7c6-2e40a27f26e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:41.984753 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197f016-4649-4527-9441-8be5f0e674ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:41.985428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197f016-4649-4527-9441-8be5f0e674ac None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:41.985867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197f016-4649-4527-9441-8be5f0e674ac None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:41.986195 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197f016-4649-4527-9441-8be5f0e674ac None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:41.986928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197f016-4649-4527-9441-8be5f0e674ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:41.987533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197f016-4649-4527-9441-8be5f0e674ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:41.988975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197f016-4649-4527-9441-8be5f0e674ac None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.004298 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 492/967] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:42.009634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197f016-4649-4527-9441-8be5f0e674ac None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.058109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 476/968] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:42.075132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93783e-19f0-4e06-b7c6-2e40a27f26e2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.126880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197f016-4649-4527-9441-8be5f0e674ac None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:42.167860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63ff8-9802-4305-b436-0efe122050cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:42.169413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63ff8-9802-4305-b436-0efe122050cd None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.170192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63ff8-9802-4305-b436-0efe122050cd None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.170677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63ff8-9802-4305-b436-0efe122050cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.180086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63ff8-9802-4305-b436-0efe122050cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:42.182438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63ff8-9802-4305-b436-0efe122050cd None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.189724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93783e-19f0-4e06-b7c6-2e40a27f26e2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-37c63ff8-9802-4305-b436-0efe122050cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:42.202383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:42.203372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 14:56:42.204321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:42.208139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 493/969] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:42.213246 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63ff8-9802-4305-b436-0efe122050cd None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.231335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f45a6-ba6e-4906-bcaa-bd2ab7889e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:42.232564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f45a6-ba6e-4906-bcaa-bd2ab7889e51 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.233051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f45a6-ba6e-4906-bcaa-bd2ab7889e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.233539 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f45a6-ba6e-4906-bcaa-bd2ab7889e51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.234433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f45a6-ba6e-4906-bcaa-bd2ab7889e51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:42.236067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f45a6-ba6e-4906-bcaa-bd2ab7889e51 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-3f5f45a6-ba6e-4906-bcaa-bd2ab7889e51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:42.248359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:42.249417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:42.250495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:42.253772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 477/970] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:42.259981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f45a6-ba6e-4906-bcaa-bd2ab7889e51 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.328662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63ff8-9802-4305-b436-0efe122050cd None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:42.364158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221399a3-1167-4106-8dae-cac568224616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:42.364856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221399a3-1167-4106-8dae-cac568224616 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.365133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221399a3-1167-4106-8dae-cac568224616 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.365451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221399a3-1167-4106-8dae-cac568224616 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.366353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221399a3-1167-4106-8dae-cac568224616 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:42.366610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221399a3-1167-4106-8dae-cac568224616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:42.368029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221399a3-1167-4106-8dae-cac568224616 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.371473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f45a6-ba6e-4906-bcaa-bd2ab7889e51 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:42.390646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 494/971] 10.222.0.44 () {56 vars in 1149 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:42.391560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221399a3-1167-4106-8dae-cac568224616 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.412707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05057d-4530-46c9-8ae8-9a83b02313ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:42.414023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05057d-4530-46c9-8ae8-9a83b02313ed None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.414535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05057d-4530-46c9-8ae8-9a83b02313ed None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.415175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05057d-4530-46c9-8ae8-9a83b02313ed None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.416675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05057d-4530-46c9-8ae8-9a83b02313ed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:42.417206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05057d-4530-46c9-8ae8-9a83b02313ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:42.419556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05057d-4530-46c9-8ae8-9a83b02313ed None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.431395 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 478/972] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:42.431712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05057d-4530-46c9-8ae8-9a83b02313ed None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.505590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221399a3-1167-4106-8dae-cac568224616 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:42.531957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05057d-4530-46c9-8ae8-9a83b02313ed None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:42.549463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046fcac-53e0-4a81-ae7b-30ec1f7cda42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:42.550463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046fcac-53e0-4a81-ae7b-30ec1f7cda42 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.550966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046fcac-53e0-4a81-ae7b-30ec1f7cda42 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.551874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046fcac-53e0-4a81-ae7b-30ec1f7cda42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.566726 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fe511-dd62-4101-b2cb-0e77c9c8510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:42.567479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fe511-dd62-4101-b2cb-0e77c9c8510f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.567761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fe511-dd62-4101-b2cb-0e77c9c8510f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.568031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fe511-dd62-4101-b2cb-0e77c9c8510f None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.569225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fe511-dd62-4101-b2cb-0e77c9c8510f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:42.569225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fe511-dd62-4101-b2cb-0e77c9c8510f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:42.570500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fe511-dd62-4101-b2cb-0e77c9c8510f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.580556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 479/973] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:42.581831 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fe511-dd62-4101-b2cb-0e77c9c8510f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.650105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046fcac-53e0-4a81-ae7b-30ec1f7cda42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:42.652125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046fcac-53e0-4a81-ae7b-30ec1f7cda42 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.685777 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fe511-dd62-4101-b2cb-0e77c9c8510f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:42.720481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d708a41-7c27-427a-bb56-025484aac54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:42.721171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d708a41-7c27-427a-bb56-025484aac54c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.721656 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d708a41-7c27-427a-bb56-025484aac54c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.721784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d708a41-7c27-427a-bb56-025484aac54c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.722574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d708a41-7c27-427a-bb56-025484aac54c None admin] RBAC: Adding query filter params (interface=admin, service_id=ee63169522704beb9202fbc0f81b6ec0, region_id=RegionOne) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:42.722873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d708a41-7c27-427a-bb56-025484aac54c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:42.724310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d708a41-7c27-427a-bb56-025484aac54c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.733832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 480/974] 10.222.0.44 () {56 vars in 1249 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/endpoints?service_id=ee63169522704beb9202fbc0f81b6ec0&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:42.734866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d708a41-7c27-427a-bb56-025484aac54c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.779564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 495/975] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:56:42.779564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87d3f-2d07-42e3-9e09-904f17665836 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.779564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87d3f-2d07-42e3-9e09-904f17665836 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.779564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab87d3f-2d07-42e3-9e09-904f17665836 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.779564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 496/976] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:42.780736 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87d3f-2d07-42e3-9e09-904f17665836 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.840939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d708a41-7c27-427a-bb56-025484aac54c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:42.874142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cceea-16b9-473c-8916-bccac0747dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:42.874803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cceea-16b9-473c-8916-bccac0747dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.875083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cceea-16b9-473c-8916-bccac0747dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.875363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cceea-16b9-473c-8916-bccac0747dc0 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.876039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cceea-16b9-473c-8916-bccac0747dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:42.877964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cceea-16b9-473c-8916-bccac0747dc0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.882599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab87d3f-2d07-42e3-9e09-904f17665836 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:42.883709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 481/977] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 14:56:42.884877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af0ac2-3205-4223-9e43-4c3a585728f8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.885161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af0ac2-3205-4223-9e43-4c3a585728f8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.885437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af0ac2-3205-4223-9e43-4c3a585728f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.902675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e3af0ac2-3205-4223-9e43-4c3a585728f8 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:42.903882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e3af0ac2-3205-4223-9e43-4c3a585728f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:42.935759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd90f-c51c-4b07-b29e-addf51b8fa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:42.937436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd90f-c51c-4b07-b29e-addf51b8fa1a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:42.937993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd90f-c51c-4b07-b29e-addf51b8fa1a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:42.938582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd90f-c51c-4b07-b29e-addf51b8fa1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:42.952368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcd90f-c51c-4b07-b29e-addf51b8fa1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:42.955061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcd90f-c51c-4b07-b29e-addf51b8fa1a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-47fcd90f-c51c-4b07-b29e-addf51b8fa1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:42.975717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:42.976739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:42.977626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:42.977626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:42.977626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:42.977626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:42.981692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 497/978] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:42.982681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd90f-c51c-4b07-b29e-addf51b8fa1a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:42.990223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 482/979] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:43.019114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af0ac2-3205-4223-9e43-4c3a585728f8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:43.108390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd90f-c51c-4b07-b29e-addf51b8fa1a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:43.145169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af0ac2-3205-4223-9e43-4c3a585728f8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:43.153762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040e600-88d5-4e30-927f-dae7c74bc72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:43.154463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e600-88d5-4e30-927f-dae7c74bc72d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:43.154745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e600-88d5-4e30-927f-dae7c74bc72d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:43.155013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e600-88d5-4e30-927f-dae7c74bc72d None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:43.155733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040e600-88d5-4e30-927f-dae7c74bc72d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:43.156068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040e600-88d5-4e30-927f-dae7c74bc72d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:43.158699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040e600-88d5-4e30-927f-dae7c74bc72d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:43.174092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 498/980] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:43.179101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040e600-88d5-4e30-927f-dae7c74bc72d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:43.189791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:43.191111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:43.191893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:43.192354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:43.193519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:43.195688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:43.197491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING keystone.server.flask.common [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 14:56:43.250518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.sql.core [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 14:56:43.250518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 14:56:43.250518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [parameters: {'user_id': 'e490bbec04c947868fb67d05e1c941ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 14:56:43.250518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80178) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application conn.query(q) May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application result.read() May 16 14:56:43.266651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:56:43.267643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application next(self.gen) May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application yield resource May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application next(self.gen) May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.session.rollback() May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.force_reraise() May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise self.value May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application session.commit() May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 14:56:43.268676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._prepare_impl() May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.session.flush() May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._flush(objects) May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application compat.raise_( May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application flush_context.execute() May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rec.execute(self) May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 14:56:43.269570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 14:56:43.270501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application result = self._query(query) May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application conn.query(q) May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application result.read() May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 14:56:43.271337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e490bbec04c947868fb67d05e1c941ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:43.272165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 14:56:43.274166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 14:56:43.275540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 14:56:43.275540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 14:56:43.275540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 14:56:43.275540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 14:56:43.275540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 14:56:43.275540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:43.275540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 483/981] 10.222.0.44 () {60 vars in 1131 bytes} [Mon May 16 14:56:43 2022] POST /identity/v3/users => generated 160 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:43.275540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:43.293559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040e600-88d5-4e30-927f-dae7c74bc72d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:43.334402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bb322-122c-47eb-acd6-890b79c0cd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:43.335477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb322-122c-47eb-acd6-890b79c0cd04 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:43.335836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb322-122c-47eb-acd6-890b79c0cd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:43.336170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb322-122c-47eb-acd6-890b79c0cd04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:43.345963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bb322-122c-47eb-acd6-890b79c0cd04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:43.348374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bb322-122c-47eb-acd6-890b79c0cd04 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-1b2bb322-122c-47eb-acd6-890b79c0cd04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:43.367769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:43.368891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:43.370013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:43.370013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:43.370013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:43.370013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:43.370013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:43.370013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:43.370013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:43.370013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:43.375827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 499/982] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:43.379030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bb322-122c-47eb-acd6-890b79c0cd04 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:43.413341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8d871-f5b6-40f5-9e14-97aaf738fffa None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:43.455552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74067da-5478-4b45-b7c2-2e2455025617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:43.456347 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74067da-5478-4b45-b7c2-2e2455025617 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:43.456617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74067da-5478-4b45-b7c2-2e2455025617 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:43.456888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74067da-5478-4b45-b7c2-2e2455025617 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:43.467533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74067da-5478-4b45-b7c2-2e2455025617 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:43.469518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74067da-5478-4b45-b7c2-2e2455025617 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:43.483655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bb322-122c-47eb-acd6-890b79c0cd04 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c74067da-5478-4b45-b7c2-2e2455025617 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:43.488123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:43.489102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 14:56:43.490099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:43.498805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 484/983] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:43.499478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74067da-5478-4b45-b7c2-2e2455025617 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:43.525136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54c4ba-830e-43a4-93e8-038476a69eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:43.525834 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54c4ba-830e-43a4-93e8-038476a69eab None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:43.526145 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54c4ba-830e-43a4-93e8-038476a69eab None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:43.526418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54c4ba-830e-43a4-93e8-038476a69eab None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:43.527197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54c4ba-830e-43a4-93e8-038476a69eab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:43.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54c4ba-830e-43a4-93e8-038476a69eab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:43.528914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54c4ba-830e-43a4-93e8-038476a69eab None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:43.548032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 500/984] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:43.549039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54c4ba-830e-43a4-93e8-038476a69eab None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:43.629688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74067da-5478-4b45-b7c2-2e2455025617 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:43.656720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54c4ba-830e-43a4-93e8-038476a69eab None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:43.673494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda4887-7c95-478f-ac72-fc179b360387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:43.674805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4887-7c95-478f-ac72-fc179b360387 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:43.675295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4887-7c95-478f-ac72-fc179b360387 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:43.675773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda4887-7c95-478f-ac72-fc179b360387 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:43.677240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda4887-7c95-478f-ac72-fc179b360387 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:43.677775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda4887-7c95-478f-ac72-fc179b360387 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:43.679857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda4887-7c95-478f-ac72-fc179b360387 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:43.691116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da23cb-dd64-4b8e-8d5e-60c9db8a2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:43.691769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da23cb-dd64-4b8e-8d5e-60c9db8a2f9e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:43.692102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da23cb-dd64-4b8e-8d5e-60c9db8a2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:43.692374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da23cb-dd64-4b8e-8d5e-60c9db8a2f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:43.693249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da23cb-dd64-4b8e-8d5e-60c9db8a2f9e None admin] RBAC: Adding query filter params (role.id=b3cef2ee2fdd4f48872310e2d4f0cc22, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=8f9bad450f474e5a835d7c70b210e60e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:43.693562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da23cb-dd64-4b8e-8d5e-60c9db8a2f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:43.695451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da23cb-dd64-4b8e-8d5e-60c9db8a2f9e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:43.706435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 501/985] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:43 2022] GET /identity/v3/role_assignments?user.id=8f9bad450f474e5a835d7c70b210e60e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=b3cef2ee2fdd4f48872310e2d4f0cc22 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:43.726628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 485/986] 10.222.0.44 () {56 vars in 1101 bytes} [Mon May 16 14:56:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:43.758384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa971315-9e81-41ca-b910-483bc943539d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:43.758749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa971315-9e81-41ca-b910-483bc943539d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:43.758945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa971315-9e81-41ca-b910-483bc943539d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:43.760721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 502/987] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:43.768852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d1512-c7c6-4360-8f22-2fb94c8bd17d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:43.769523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d1512-c7c6-4360-8f22-2fb94c8bd17d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:43.770028 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d1512-c7c6-4360-8f22-2fb94c8bd17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:43.789104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7e9d1512-c7c6-4360-8f22-2fb94c8bd17d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:43.791232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7e9d1512-c7c6-4360-8f22-2fb94c8bd17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:43.871166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 486/988] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:43.893686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa971315-9e81-41ca-b910-483bc943539d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:44.007252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa971315-9e81-41ca-b910-483bc943539d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:44.040182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1edbe6-5d7c-4aa7-aac4-56263ba4689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:44.040882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1edbe6-5d7c-4aa7-aac4-56263ba4689e None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:44.041171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1edbe6-5d7c-4aa7-aac4-56263ba4689e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:44.041441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1edbe6-5d7c-4aa7-aac4-56263ba4689e None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:44.042221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1edbe6-5d7c-4aa7-aac4-56263ba4689e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:44.043596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1edbe6-5d7c-4aa7-aac4-56263ba4689e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:44.131353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 503/989] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:56:43 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:45.172176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc08b8-9579-4845-8781-dd792f57ff7a None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:45.172667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc08b8-9579-4845-8781-dd792f57ff7a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:45.172744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc08b8-9579-4845-8781-dd792f57ff7a None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:45.174303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 487/990] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:45.179646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef089e4-a6d4-4be5-8719-1e23a73c29fa None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:45.180020 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef089e4-a6d4-4be5-8719-1e23a73c29fa None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:45.180201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef089e4-a6d4-4be5-8719-1e23a73c29fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:45.196842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-eef089e4-a6d4-4be5-8719-1e23a73c29fa None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:45.198008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-eef089e4-a6d4-4be5-8719-1e23a73c29fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:45.270582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 504/991] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:45.293638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc08b8-9579-4845-8781-dd792f57ff7a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:45.394704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc08b8-9579-4845-8781-dd792f57ff7a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:45.426858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0540-1fa2-4dc0-bb2f-fb8d1a06bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:45.427652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0540-1fa2-4dc0-bb2f-fb8d1a06bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:45.427929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0540-1fa2-4dc0-bb2f-fb8d1a06bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:45.428194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0540-1fa2-4dc0-bb2f-fb8d1a06bbb3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:45.428836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b0540-1fa2-4dc0-bb2f-fb8d1a06bbb3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:45.430218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b0540-1fa2-4dc0-bb2f-fb8d1a06bbb3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-966b0540-1fa2-4dc0-bb2f-fb8d1a06bbb3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:45.442447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:45.443473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:45.444338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 488/992] 10.222.0.44 () {56 vars in 1126 bytes} [Mon May 16 14:56:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:45.454268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef089e4-a6d4-4be5-8719-1e23a73c29fa None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:45.545788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef089e4-a6d4-4be5-8719-1e23a73c29fa None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:45.578740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55ecd3-04e7-4fbe-b0e0-596228379485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:45.579404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55ecd3-04e7-4fbe-b0e0-596228379485 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:45.579712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55ecd3-04e7-4fbe-b0e0-596228379485 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:45.579986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55ecd3-04e7-4fbe-b0e0-596228379485 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:45.580718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55ecd3-04e7-4fbe-b0e0-596228379485 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:45.581026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55ecd3-04e7-4fbe-b0e0-596228379485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:45.582427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55ecd3-04e7-4fbe-b0e0-596228379485 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:45.591966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 505/993] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:45.593206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0540-1fa2-4dc0-bb2f-fb8d1a06bbb3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:45.688213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0540-1fa2-4dc0-bb2f-fb8d1a06bbb3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:45.720716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd87e78-117a-4667-ae31-d2f50a4f4f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:45.721379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd87e78-117a-4667-ae31-d2f50a4f4f58 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:45.721663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd87e78-117a-4667-ae31-d2f50a4f4f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:45.721939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd87e78-117a-4667-ae31-d2f50a4f4f58 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:45.722672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd87e78-117a-4667-ae31-d2f50a4f4f58 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:45.722979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd87e78-117a-4667-ae31-d2f50a4f4f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:45.724344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd87e78-117a-4667-ae31-d2f50a4f4f58 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:45.729374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 489/994] 10.222.0.44 () {56 vars in 1122 bytes} [Mon May 16 14:56:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:45.734785 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55ecd3-04e7-4fbe-b0e0-596228379485 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:45.833978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55ecd3-04e7-4fbe-b0e0-596228379485 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:45.866874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d3bde-27db-438f-9c97-c63fca129cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:45.867534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3bde-27db-438f-9c97-c63fca129cc6 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:45.867817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3bde-27db-438f-9c97-c63fca129cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:45.868093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3bde-27db-438f-9c97-c63fca129cc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:45.868842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d3bde-27db-438f-9c97-c63fca129cc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:45.870242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d3bde-27db-438f-9c97-c63fca129cc6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:45.979942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f733e-6870-4947-989b-05d728f999b6 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:45.980161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f733e-6870-4947-989b-05d728f999b6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:45.980458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f733e-6870-4947-989b-05d728f999b6 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:45.981846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 490/995] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:45.987571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29f4e-5f4b-4881-b2f5-1604025df35c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:45.987859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29f4e-5f4b-4881-b2f5-1604025df35c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:45.988133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29f4e-5f4b-4881-b2f5-1604025df35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:45.994348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 506/996] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 16 14:56:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:46.007956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-02f29f4e-5f4b-4881-b2f5-1604025df35c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:46.009300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-02f29f4e-5f4b-4881-b2f5-1604025df35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:46.091192 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 491/997] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:46.113864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d3bde-27db-438f-9c97-c63fca129cc6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:46.222340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d3bde-27db-438f-9c97-c63fca129cc6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:46.256186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caa1b7-3a07-4457-bbdb-1b9f20ea5fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:46.256938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caa1b7-3a07-4457-bbdb-1b9f20ea5fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:46.257220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caa1b7-3a07-4457-bbdb-1b9f20ea5fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:46.257488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caa1b7-3a07-4457-bbdb-1b9f20ea5fb1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:46.258171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caa1b7-3a07-4457-bbdb-1b9f20ea5fb1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:46.259531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caa1b7-3a07-4457-bbdb-1b9f20ea5fb1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c5caa1b7-3a07-4457-bbdb-1b9f20ea5fb1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:46.270846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:46.271830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:46.272656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 507/998] 10.222.0.44 () {56 vars in 1105 bytes} [Mon May 16 14:56:46 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:46.277928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29f4e-5f4b-4881-b2f5-1604025df35c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:46.375304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29f4e-5f4b-4881-b2f5-1604025df35c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:46.388916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759dd88-c826-4c10-ae79-cb7dc4c02b81 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:46.389230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759dd88-c826-4c10-ae79-cb7dc4c02b81 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:46.389474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759dd88-c826-4c10-ae79-cb7dc4c02b81 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:46.391033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 508/999] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:46.396389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdd163-c7d0-4c9a-852f-10b13a8e0afe None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:46.396680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdd163-c7d0-4c9a-852f-10b13a8e0afe None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:46.396958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdd163-c7d0-4c9a-852f-10b13a8e0afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:46.410807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3db53d-64ce-4ae4-9aeb-907d59ac3533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:46.411474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3db53d-64ce-4ae4-9aeb-907d59ac3533 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:46.411812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3db53d-64ce-4ae4-9aeb-907d59ac3533 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:46.412093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3db53d-64ce-4ae4-9aeb-907d59ac3533 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:46.412816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3db53d-64ce-4ae4-9aeb-907d59ac3533 None admin] RBAC: Adding query filter params (name=image) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:46.413127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3db53d-64ce-4ae4-9aeb-907d59ac3533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:46.413669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7abdd163-c7d0-4c9a-852f-10b13a8e0afe None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:46.414543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3db53d-64ce-4ae4-9aeb-907d59ac3533 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:46.414868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7abdd163-c7d0-4c9a-852f-10b13a8e0afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:46.424037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 492/1000] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:46.425415 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3db53d-64ce-4ae4-9aeb-907d59ac3533 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:46.481020 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 509/1001] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:46 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:46.503375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdd163-c7d0-4c9a-852f-10b13a8e0afe None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:46.529894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3db53d-64ce-4ae4-9aeb-907d59ac3533 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:46.563694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9461e7-69b2-43e7-a3a5-804ac0fa7525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:46.565243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9461e7-69b2-43e7-a3a5-804ac0fa7525 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:46.565681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9461e7-69b2-43e7-a3a5-804ac0fa7525 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:46.566139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9461e7-69b2-43e7-a3a5-804ac0fa7525 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:46.566987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9461e7-69b2-43e7-a3a5-804ac0fa7525 None admin] RBAC: Adding query filter params (type=image) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:46.567444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9461e7-69b2-43e7-a3a5-804ac0fa7525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:46.568976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9461e7-69b2-43e7-a3a5-804ac0fa7525 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:46.582082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 493/1002] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:46.601636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdd163-c7d0-4c9a-852f-10b13a8e0afe None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:46.637537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad9c35-2470-4543-afb3-306573d5f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:46.638380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad9c35-2470-4543-afb3-306573d5f4dd None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:46.638657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad9c35-2470-4543-afb3-306573d5f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:46.638927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad9c35-2470-4543-afb3-306573d5f4dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:46.639592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad9c35-2470-4543-afb3-306573d5f4dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:46.641004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad9c35-2470-4543-afb3-306573d5f4dd None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-16ad9c35-2470-4543-afb3-306573d5f4dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:46.653369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:46.654701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:46.655775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 510/1003] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:46.660812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9461e7-69b2-43e7-a3a5-804ac0fa7525 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:46.763123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9461e7-69b2-43e7-a3a5-804ac0fa7525 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:46.797440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b54b5-4814-4957-bbc2-b155565bc7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:46.798157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b54b5-4814-4957-bbc2-b155565bc7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:46.799058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b54b5-4814-4957-bbc2-b155565bc7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:46.799336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b54b5-4814-4957-bbc2-b155565bc7e9 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:46.800036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b54b5-4814-4957-bbc2-b155565bc7e9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:46.800340 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b54b5-4814-4957-bbc2-b155565bc7e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:46.801705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b54b5-4814-4957-bbc2-b155565bc7e9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:46.806519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 494/1004] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:46.812383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad9c35-2470-4543-afb3-306573d5f4dd None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:46.907656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad9c35-2470-4543-afb3-306573d5f4dd None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:46.940199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1208-fbc5-434d-96aa-e6cd849be651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:46.940860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1208-fbc5-434d-96aa-e6cd849be651 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:46.941142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1208-fbc5-434d-96aa-e6cd849be651 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:46.941413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1208-fbc5-434d-96aa-e6cd849be651 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:46.942148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c1208-fbc5-434d-96aa-e6cd849be651 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:46.942460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c1208-fbc5-434d-96aa-e6cd849be651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:46.943821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c1208-fbc5-434d-96aa-e6cd849be651 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:46.953154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 511/1005] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:46.954704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b54b5-4814-4957-bbc2-b155565bc7e9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:47.055976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b54b5-4814-4957-bbc2-b155565bc7e9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:47.093475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68868e-7b04-4698-a134-444a9ee50bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:47.094196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68868e-7b04-4698-a134-444a9ee50bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:47.094482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68868e-7b04-4698-a134-444a9ee50bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:47.094754 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68868e-7b04-4698-a134-444a9ee50bd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:47.096236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68868e-7b04-4698-a134-444a9ee50bd9 None admin] RBAC: Adding query filter params (interface=public, service_id=15f6094cf5e2428aaf4b00df70146daa, region_id=RegionOne) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:47.096551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68868e-7b04-4698-a134-444a9ee50bd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:47.097912 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68868e-7b04-4698-a134-444a9ee50bd9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:47.107068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 495/1006] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 16 14:56:46 2022] GET /identity/v3/endpoints?service_id=15f6094cf5e2428aaf4b00df70146daa&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:47.108183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1208-fbc5-434d-96aa-e6cd849be651 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:47.207147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1208-fbc5-434d-96aa-e6cd849be651 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:47.239916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e910a-eff7-40e7-b468-b60bbd9c80aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:47.240682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e910a-eff7-40e7-b468-b60bbd9c80aa None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:47.240863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e910a-eff7-40e7-b468-b60bbd9c80aa None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:47.241131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e910a-eff7-40e7-b468-b60bbd9c80aa None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:47.241814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e910a-eff7-40e7-b468-b60bbd9c80aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:47.243316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e910a-eff7-40e7-b468-b60bbd9c80aa None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:47.254754 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 512/1007] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 16 14:56:47 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 14:56:48.267139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34906e-1a13-4368-b77b-efe9e72007f8 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:48.267913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34906e-1a13-4368-b77b-efe9e72007f8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:48.267913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34906e-1a13-4368-b77b-efe9e72007f8 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:48.269278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 496/1008] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:48.274680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5737d6-f2ca-4e06-ac86-35b16ef9f054 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:48.275095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5737d6-f2ca-4e06-ac86-35b16ef9f054 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:48.275239 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5737d6-f2ca-4e06-ac86-35b16ef9f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:48.292220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-da5737d6-f2ca-4e06-ac86-35b16ef9f054 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:48.293397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-da5737d6-f2ca-4e06-ac86-35b16ef9f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:48.357480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 513/1009] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:48.382380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34906e-1a13-4368-b77b-efe9e72007f8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:48.480536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34906e-1a13-4368-b77b-efe9e72007f8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:48.512871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadd41f-680e-421f-8b98-9604ca60dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:48.513667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadd41f-680e-421f-8b98-9604ca60dd80 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:48.513948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadd41f-680e-421f-8b98-9604ca60dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:48.514251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadd41f-680e-421f-8b98-9604ca60dd80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:48.515431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadd41f-680e-421f-8b98-9604ca60dd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:48.516909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadd41f-680e-421f-8b98-9604ca60dd80 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:48.523843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 497/1010] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:48.525036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5737d6-f2ca-4e06-ac86-35b16ef9f054 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:48.618045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5737d6-f2ca-4e06-ac86-35b16ef9f054 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:48.652877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110d76-bd57-4d07-be5b-4a35c6b0840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:48.653533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110d76-bd57-4d07-be5b-4a35c6b0840f None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:48.653808 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110d76-bd57-4d07-be5b-4a35c6b0840f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:48.654274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110d76-bd57-4d07-be5b-4a35c6b0840f None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:48.654979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110d76-bd57-4d07-be5b-4a35c6b0840f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:48.656428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110d76-bd57-4d07-be5b-4a35c6b0840f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:48.750092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 514/1011] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:56:48 2022] POST /identity/v3/projects => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:48.804805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa4c1-7bd4-4c86-a334-a649b9df00fb None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:48.805132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa4c1-7bd4-4c86-a334-a649b9df00fb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:48.805366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa4c1-7bd4-4c86-a334-a649b9df00fb None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:48.806831 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 498/1012] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:48.812910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb367bf-68a2-4382-b06a-9a51bf933396 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:48.813286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb367bf-68a2-4382-b06a-9a51bf933396 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:48.813638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb367bf-68a2-4382-b06a-9a51bf933396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:48.832032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ebb367bf-68a2-4382-b06a-9a51bf933396 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:48.833329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ebb367bf-68a2-4382-b06a-9a51bf933396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:48.906191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 515/1013] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:48.929555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aa4c1-7bd4-4c86-a334-a649b9df00fb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:49.030479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aa4c1-7bd4-4c86-a334-a649b9df00fb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:49.063468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d137985-2226-450e-9ec6-225e99f6c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:49.064167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137985-2226-450e-9ec6-225e99f6c80b None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:49.064445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137985-2226-450e-9ec6-225e99f6c80b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:49.064714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d137985-2226-450e-9ec6-225e99f6c80b None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:49.065440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d137985-2226-450e-9ec6-225e99f6c80b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:49.066828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d137985-2226-450e-9ec6-225e99f6c80b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:49.211081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 499/1014] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:56:48 2022] POST /identity/v3/services => generated 242 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:49.492344 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a60af-7f97-45a4-a698-cbeb4bb3fa79 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:49.492833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a60af-7f97-45a4-a698-cbeb4bb3fa79 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:49.492833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a60af-7f97-45a4-a698-cbeb4bb3fa79 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:49.494383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 516/1015] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:49.499485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993046d2-c602-4c35-8329-edeb029a60dc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:49.499904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993046d2-c602-4c35-8329-edeb029a60dc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:49.500092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993046d2-c602-4c35-8329-edeb029a60dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:49.516373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-993046d2-c602-4c35-8329-edeb029a60dc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:49.518030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-993046d2-c602-4c35-8329-edeb029a60dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:49.587391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 500/1016] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:49 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:49.609819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a60af-7f97-45a4-a698-cbeb4bb3fa79 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:49.706531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a60af-7f97-45a4-a698-cbeb4bb3fa79 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:49.738915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaafa7-97c9-4557-bc00-6de5dda25626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:49.739691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaafa7-97c9-4557-bc00-6de5dda25626 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:49.739966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaafa7-97c9-4557-bc00-6de5dda25626 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:49.740236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aaafa7-97c9-4557-bc00-6de5dda25626 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:49.740878 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aaafa7-97c9-4557-bc00-6de5dda25626 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:49.742758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aaafa7-97c9-4557-bc00-6de5dda25626 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-f7aaafa7-97c9-4557-bc00-6de5dda25626 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:49.754081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:49.755082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 14:56:49.755952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:49.758371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 517/1017] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:49.761391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993046d2-c602-4c35-8329-edeb029a60dc None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:49.854117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993046d2-c602-4c35-8329-edeb029a60dc None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:49.886426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54667f16-8cd0-48c7-b457-a655519acd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:49.887373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54667f16-8cd0-48c7-b457-a655519acd77 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:49.887854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54667f16-8cd0-48c7-b457-a655519acd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:49.888347 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54667f16-8cd0-48c7-b457-a655519acd77 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:49.889246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54667f16-8cd0-48c7-b457-a655519acd77 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:49.889756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54667f16-8cd0-48c7-b457-a655519acd77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:49.891355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54667f16-8cd0-48c7-b457-a655519acd77 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:49.897050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 501/1018] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:49.902543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaafa7-97c9-4557-bc00-6de5dda25626 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:50.003725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aaafa7-97c9-4557-bc00-6de5dda25626 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:50.033705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96cd6-3108-4e4e-b39c-78afd55f0a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:50.034461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96cd6-3108-4e4e-b39c-78afd55f0a92 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:50.034739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96cd6-3108-4e4e-b39c-78afd55f0a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:50.035004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96cd6-3108-4e4e-b39c-78afd55f0a92 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:50.035703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96cd6-3108-4e4e-b39c-78afd55f0a92 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:50.036003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96cd6-3108-4e4e-b39c-78afd55f0a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:50.037369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96cd6-3108-4e4e-b39c-78afd55f0a92 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:50.042226 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 518/1019] 10.222.0.44 () {56 vars in 1112 bytes} [Mon May 16 14:56:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:50.047720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54667f16-8cd0-48c7-b457-a655519acd77 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:50.141836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54667f16-8cd0-48c7-b457-a655519acd77 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:50.175952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21553e0e-c1ee-4351-b8ae-63fece288980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:50.176606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21553e0e-c1ee-4351-b8ae-63fece288980 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:50.176885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21553e0e-c1ee-4351-b8ae-63fece288980 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:50.177159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21553e0e-c1ee-4351-b8ae-63fece288980 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:50.177899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21553e0e-c1ee-4351-b8ae-63fece288980 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:50.179310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21553e0e-c1ee-4351-b8ae-63fece288980 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:50.278175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 502/1020] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 16 14:56:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:51.032675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856793b-4d64-4519-b4b8-737300e1575a None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:51.033803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856793b-4d64-4519-b4b8-737300e1575a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:51.033803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856793b-4d64-4519-b4b8-737300e1575a None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:51.035349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 519/1021] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:51.040450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047bd49-736f-48d9-ae84-6eae0d7aad20 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:51.040861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047bd49-736f-48d9-ae84-6eae0d7aad20 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:51.041032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047bd49-736f-48d9-ae84-6eae0d7aad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:51.058238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2047bd49-736f-48d9-ae84-6eae0d7aad20 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:51.059409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2047bd49-736f-48d9-ae84-6eae0d7aad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:51.129947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 503/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:51.154580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856793b-4d64-4519-b4b8-737300e1575a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:51.252408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856793b-4d64-4519-b4b8-737300e1575a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:51.286383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18babb07-7da7-4e63-aeac-8feeadc46e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:51.287205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18babb07-7da7-4e63-aeac-8feeadc46e46 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:51.287486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18babb07-7da7-4e63-aeac-8feeadc46e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:51.287760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18babb07-7da7-4e63-aeac-8feeadc46e46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:51.289025 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18babb07-7da7-4e63-aeac-8feeadc46e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:51.290531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18babb07-7da7-4e63-aeac-8feeadc46e46 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:51.297032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 520/1023] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:51.299432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047bd49-736f-48d9-ae84-6eae0d7aad20 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:51.394675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047bd49-736f-48d9-ae84-6eae0d7aad20 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:51.432021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ac71-4d76-4ea2-ac36-16c9cd1a7d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:51.432699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ac71-4d76-4ea2-ac36-16c9cd1a7d18 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:51.432982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ac71-4d76-4ea2-ac36-16c9cd1a7d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:51.433257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ac71-4d76-4ea2-ac36-16c9cd1a7d18 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:51.433960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4ac71-4d76-4ea2-ac36-16c9cd1a7d18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:51.435423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4ac71-4d76-4ea2-ac36-16c9cd1a7d18 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:51.457898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8bf2e-ce45-407d-8f40-f8ddfc1366bc None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:51.458611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8bf2e-ce45-407d-8f40-f8ddfc1366bc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:51.458611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8bf2e-ce45-407d-8f40-f8ddfc1366bc None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:51.459910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 521/1024] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:51.465026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c1f0-0590-4a9f-bebb-1d94ec3702a0 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:51.465342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c1f0-0590-4a9f-bebb-1d94ec3702a0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:51.465610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c1f0-0590-4a9f-bebb-1d94ec3702a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:51.482731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a878c1f0-0590-4a9f-bebb-1d94ec3702a0 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:51.483985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a878c1f0-0590-4a9f-bebb-1d94ec3702a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:51.541310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 504/1025] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:56:51 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:56:51.556224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 522/1026] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:51.579100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ac71-4d76-4ea2-ac36-16c9cd1a7d18 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:51.684145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ac71-4d76-4ea2-ac36-16c9cd1a7d18 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:51.719622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d570-350a-4e15-88b1-95403be1105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:51.721024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d570-350a-4e15-88b1-95403be1105d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:51.721306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d570-350a-4e15-88b1-95403be1105d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:51.721589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d570-350a-4e15-88b1-95403be1105d None admin] PATH_INFO: `/v3/services/image` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:51.722259 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d570-350a-4e15-88b1-95403be1105d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:51.723635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d570-350a-4e15-88b1-95403be1105d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9759d570-350a-4e15-88b1-95403be1105d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:51.735172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:51.736244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:51.737117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 505/1027] 10.222.0.44 () {56 vars in 1105 bytes} [Mon May 16 14:56:51 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:51.743053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878c1f0-0590-4a9f-bebb-1d94ec3702a0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:51.840975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878c1f0-0590-4a9f-bebb-1d94ec3702a0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:51.873449 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8636d-4aa2-4049-93b5-c53fcfb73c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:51.874509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8636d-4aa2-4049-93b5-c53fcfb73c6a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:51.875016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8636d-4aa2-4049-93b5-c53fcfb73c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:51.875507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8636d-4aa2-4049-93b5-c53fcfb73c6a None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:51.876414 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8636d-4aa2-4049-93b5-c53fcfb73c6a None admin] RBAC: Adding query filter params (name=image) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:51.876945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8636d-4aa2-4049-93b5-c53fcfb73c6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:51.878562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8636d-4aa2-4049-93b5-c53fcfb73c6a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:51.883793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 523/1028] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:51.889021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d570-350a-4e15-88b1-95403be1105d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:51.986213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d570-350a-4e15-88b1-95403be1105d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:52.020422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed25372-b906-4d71-930d-bf25711aad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:52.021473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed25372-b906-4d71-930d-bf25711aad4f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:52.021984 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed25372-b906-4d71-930d-bf25711aad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:52.022505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed25372-b906-4d71-930d-bf25711aad4f None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:52.023427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed25372-b906-4d71-930d-bf25711aad4f None admin] RBAC: Adding query filter params (type=image) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:52.023936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed25372-b906-4d71-930d-bf25711aad4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:52.025552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed25372-b906-4d71-930d-bf25711aad4f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:52.030856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 506/1029] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:52.036258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8636d-4aa2-4049-93b5-c53fcfb73c6a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:52.131805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8636d-4aa2-4049-93b5-c53fcfb73c6a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:52.163969 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b1417-05db-41b5-bbea-d810c9f73ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:52.164630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b1417-05db-41b5-bbea-d810c9f73ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:52.164910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b1417-05db-41b5-bbea-d810c9f73ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:52.165181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b1417-05db-41b5-bbea-d810c9f73ac3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:52.165967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b1417-05db-41b5-bbea-d810c9f73ac3 None admin] RBAC: Adding query filter params (interface=public, service_id=f1a118835d2a4224999b78c50c56c959, region_id=RegionOne) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:52.166305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b1417-05db-41b5-bbea-d810c9f73ac3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:52.167671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b1417-05db-41b5-bbea-d810c9f73ac3 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:52.172772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 524/1030] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 16 14:56:52 2022] GET /identity/v3/endpoints?service_id=f1a118835d2a4224999b78c50c56c959&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:52.178134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed25372-b906-4d71-930d-bf25711aad4f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:52.273171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed25372-b906-4d71-930d-bf25711aad4f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:52.304939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5611a-af3a-4a31-8faf-c7165a5cbb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:52.305603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5611a-af3a-4a31-8faf-c7165a5cbb28 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:52.305884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5611a-af3a-4a31-8faf-c7165a5cbb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:52.306185 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5611a-af3a-4a31-8faf-c7165a5cbb28 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:52.306871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5611a-af3a-4a31-8faf-c7165a5cbb28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:52.308230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5611a-af3a-4a31-8faf-c7165a5cbb28 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:52.322171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 507/1031] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 16 14:56:52 2022] GET /identity/v3/services => generated 1957 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 14:56:52.623639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb1a10-4806-46ee-8da2-f273ed3822a1 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:52.623916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb1a10-4806-46ee-8da2-f273ed3822a1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:52.624194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb1a10-4806-46ee-8da2-f273ed3822a1 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:52.625759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 525/1032] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:52.631562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3616f-b55a-43b7-8544-4436aead3133 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:52.631849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3616f-b55a-43b7-8544-4436aead3133 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:52.632173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3616f-b55a-43b7-8544-4436aead3133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:52.648768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-23b3616f-b55a-43b7-8544-4436aead3133 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:52.649967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-23b3616f-b55a-43b7-8544-4436aead3133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:52.714756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 508/1033] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:52.739372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb1a10-4806-46ee-8da2-f273ed3822a1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:52.837940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb1a10-4806-46ee-8da2-f273ed3822a1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:52.872138 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a313b0-ee49-4612-80d4-9dc6dbd8e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:52.872947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a313b0-ee49-4612-80d4-9dc6dbd8e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:52.873225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a313b0-ee49-4612-80d4-9dc6dbd8e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:52.873496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a313b0-ee49-4612-80d4-9dc6dbd8e8c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:52.883308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a313b0-ee49-4612-80d4-9dc6dbd8e8c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-22a313b0-ee49-4612-80d4-9dc6dbd8e8c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:52.891342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:52.892266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:52.893092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 526/1034] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 16 14:56:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:52.900630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3616f-b55a-43b7-8544-4436aead3133 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:52.993244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3616f-b55a-43b7-8544-4436aead3133 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:53.025748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103772da-8d75-4128-9146-be83c18243f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:53.026449 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103772da-8d75-4128-9146-be83c18243f5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:53.026728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103772da-8d75-4128-9146-be83c18243f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:53.026999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103772da-8d75-4128-9146-be83c18243f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:53.027734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103772da-8d75-4128-9146-be83c18243f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:53.028037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103772da-8d75-4128-9146-be83c18243f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:53.029394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103772da-8d75-4128-9146-be83c18243f5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:53.042201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 509/1035] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 16 14:56:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:53.043489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a313b0-ee49-4612-80d4-9dc6dbd8e8c6 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:53.140922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a313b0-ee49-4612-80d4-9dc6dbd8e8c6 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:53.173302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce22c-2c3b-4d30-b211-21d5191366d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:53.174185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ce22c-2c3b-4d30-b211-21d5191366d9 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:53.174465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ce22c-2c3b-4d30-b211-21d5191366d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:53.174734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ce22c-2c3b-4d30-b211-21d5191366d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:53.185660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ce22c-2c3b-4d30-b211-21d5191366d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:53.187251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ce22c-2c3b-4d30-b211-21d5191366d9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-764ce22c-2c3b-4d30-b211-21d5191366d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:53.203542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:53.204445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:53.206033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:53.206033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:53.206033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:53.206033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:53.206033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 527/1036] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:53.210923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103772da-8d75-4128-9146-be83c18243f5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:53.307334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103772da-8d75-4128-9146-be83c18243f5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:53.340168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989740e0-f127-4bf7-bce2-684cf243abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:53.340924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989740e0-f127-4bf7-bce2-684cf243abba None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:53.341203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989740e0-f127-4bf7-bce2-684cf243abba None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:53.341496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989740e0-f127-4bf7-bce2-684cf243abba None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:53.342249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989740e0-f127-4bf7-bce2-684cf243abba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:53.342571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989740e0-f127-4bf7-bce2-684cf243abba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:53.343941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989740e0-f127-4bf7-bce2-684cf243abba None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:53.361425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 510/1037] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:53.363213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce22c-2c3b-4d30-b211-21d5191366d9 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:53.457178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce22c-2c3b-4d30-b211-21d5191366d9 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:53.491561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788098b-466f-4e83-bcd6-16d0ac0f8564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:53.492341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788098b-466f-4e83-bcd6-16d0ac0f8564 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:53.492613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788098b-466f-4e83-bcd6-16d0ac0f8564 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:53.492882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788098b-466f-4e83-bcd6-16d0ac0f8564 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:53.500316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788098b-466f-4e83-bcd6-16d0ac0f8564 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:53.501769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788098b-466f-4e83-bcd6-16d0ac0f8564 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-a788098b-466f-4e83-bcd6-16d0ac0f8564 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:53.515305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:53.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:53.522181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 528/1038] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 16 14:56:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:53.524302 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989740e0-f127-4bf7-bce2-684cf243abba None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:53.620495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989740e0-f127-4bf7-bce2-684cf243abba None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:53.651810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb5d6c-607d-45f3-9dfe-10e561569ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:53.652471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb5d6c-607d-45f3-9dfe-10e561569ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:53.652745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb5d6c-607d-45f3-9dfe-10e561569ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:53.653015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb5d6c-607d-45f3-9dfe-10e561569ca5 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:53.653826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb5d6c-607d-45f3-9dfe-10e561569ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:53.654155 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb5d6c-607d-45f3-9dfe-10e561569ca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:53.655573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb5d6c-607d-45f3-9dfe-10e561569ca5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:53.677671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 511/1039] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 16 14:56:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:53.678939 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788098b-466f-4e83-bcd6-16d0ac0f8564 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:53.777369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788098b-466f-4e83-bcd6-16d0ac0f8564 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:53.808159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a3b8c-7fb5-475c-b05a-eddd46b169bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:53.808792 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a3b8c-7fb5-475c-b05a-eddd46b169bc None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:53.809067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a3b8c-7fb5-475c-b05a-eddd46b169bc None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:53.809334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a3b8c-7fb5-475c-b05a-eddd46b169bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:53.867844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b834-2b16-4796-9a12-fc984b2297d4 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:53.868131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b834-2b16-4796-9a12-fc984b2297d4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:53.868414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5b834-2b16-4796-9a12-fc984b2297d4 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:53.869791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 512/1040] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:53.874855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8bb93-ca37-409d-b06d-4e4a2837c352 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:53.875164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8bb93-ca37-409d-b06d-4e4a2837c352 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:53.875428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8bb93-ca37-409d-b06d-4e4a2837c352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:53.876256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a3b8c-7fb5-475c-b05a-eddd46b169bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:53.878455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a3b8c-7fb5-475c-b05a-eddd46b169bc None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:53.893978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5ec8bb93-ca37-409d-b06d-4e4a2837c352 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:53.895196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5ec8bb93-ca37-409d-b06d-4e4a2837c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:53.960372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 513/1041] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:53.979145 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 529/1042] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:56:53.984419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8bb93-ca37-409d-b06d-4e4a2837c352 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:53.984561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a3b8c-7fb5-475c-b05a-eddd46b169bc None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.082250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8bb93-ca37-409d-b06d-4e4a2837c352 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.083000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a3b8c-7fb5-475c-b05a-eddd46b169bc None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.115181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d208f-b967-41b6-899a-5cc3a2ad4e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.115418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c84b6-cd49-4e59-babd-4c98a200a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.115973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d208f-b967-41b6-899a-5cc3a2ad4e10 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.116142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c84b6-cd49-4e59-babd-4c98a200a01e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.116236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d208f-b967-41b6-899a-5cc3a2ad4e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.116424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c84b6-cd49-4e59-babd-4c98a200a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.116531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d208f-b967-41b6-899a-5cc3a2ad4e10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.116694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c84b6-cd49-4e59-babd-4c98a200a01e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.126400 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c84b6-cd49-4e59-babd-4c98a200a01e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:54.127093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d208f-b967-41b6-899a-5cc3a2ad4e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:54.127863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c84b6-cd49-4e59-babd-4c98a200a01e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-014d208f-b967-41b6-899a-5cc3a2ad4e10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:54.135246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:54.136223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:54.137057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:54.137700 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 514/1043] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:54.143301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d208f-b967-41b6-899a-5cc3a2ad4e10 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-024c84b6-cd49-4e59-babd-4c98a200a01e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:54.146470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:54.147323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:54.148238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:54.148238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:54.148238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:54.148238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:54.148238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 530/1044] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:54.152965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c84b6-cd49-4e59-babd-4c98a200a01e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.243731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d208f-b967-41b6-899a-5cc3a2ad4e10 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.251053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c84b6-cd49-4e59-babd-4c98a200a01e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.275832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0e8b-2ca8-443b-b8b6-2d3417f9bb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.276498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0e8b-2ca8-443b-b8b6-2d3417f9bb01 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.276780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0e8b-2ca8-443b-b8b6-2d3417f9bb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.277055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0e8b-2ca8-443b-b8b6-2d3417f9bb01 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.277794 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b0e8b-2ca8-443b-b8b6-2d3417f9bb01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:54.278135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b0e8b-2ca8-443b-b8b6-2d3417f9bb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:54.279507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b0e8b-2ca8-443b-b8b6-2d3417f9bb01 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:54.285193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339b02d-919c-466c-8080-c0cf33bb15b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.286098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339b02d-919c-466c-8080-c0cf33bb15b2 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.286574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339b02d-919c-466c-8080-c0cf33bb15b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.287021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339b02d-919c-466c-8080-c0cf33bb15b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.287933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 515/1045] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:54.288083 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339b02d-919c-466c-8080-c0cf33bb15b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:54.288405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339b02d-919c-466c-8080-c0cf33bb15b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:54.289771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339b02d-919c-466c-8080-c0cf33bb15b2 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:54.293594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0e8b-2ca8-443b-b8b6-2d3417f9bb01 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.307743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 531/1046] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:54.308820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339b02d-919c-466c-8080-c0cf33bb15b2 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.391801 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0e8b-2ca8-443b-b8b6-2d3417f9bb01 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.406371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339b02d-919c-466c-8080-c0cf33bb15b2 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.427890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394ee1-0e3d-4f65-9936-4d959e836470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.429022 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394ee1-0e3d-4f65-9936-4d959e836470 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.429452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394ee1-0e3d-4f65-9936-4d959e836470 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.429727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394ee1-0e3d-4f65-9936-4d959e836470 None admin] PATH_INFO: `/v3/users/cbf836b409f14c37bd6a15decffcd432` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.441694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c51d6-ae16-400b-bc3c-c4edbff09322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.442521 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c51d6-ae16-400b-bc3c-c4edbff09322 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.442796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c51d6-ae16-400b-bc3c-c4edbff09322 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.443068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c51d6-ae16-400b-bc3c-c4edbff09322 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.443652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b394ee1-0e3d-4f65-9936-4d959e836470 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf836b409f14c37bd6a15decffcd432)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:54.445097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b394ee1-0e3d-4f65-9936-4d959e836470 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:54.451469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 516/1047] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/users/cbf836b409f14c37bd6a15decffcd432 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:54.451604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c51d6-ae16-400b-bc3c-c4edbff09322 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:54.451604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c51d6-ae16-400b-bc3c-c4edbff09322 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:54.452272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394ee1-0e3d-4f65-9936-4d959e836470 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-9b7c51d6-ae16-400b-bc3c-c4edbff09322 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:54.466476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:54.467378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:54.468264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:54.468264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:54.468264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:54.468264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:54.468264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:54.468264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:54.468264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:54.468264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:54.468264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 532/1048] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:54.473752 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c51d6-ae16-400b-bc3c-c4edbff09322 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.553641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394ee1-0e3d-4f65-9936-4d959e836470 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.569840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c51d6-ae16-400b-bc3c-c4edbff09322 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.587867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faf626-ca41-42bf-bb52-b125dda7620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.588519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faf626-ca41-42bf-bb52-b125dda7620e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.588796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faf626-ca41-42bf-bb52-b125dda7620e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.589310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faf626-ca41-42bf-bb52-b125dda7620e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.607088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e15123-1ed7-41d1-a49a-6e44eb790696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.607748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e15123-1ed7-41d1-a49a-6e44eb790696 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.608077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e15123-1ed7-41d1-a49a-6e44eb790696 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.608347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e15123-1ed7-41d1-a49a-6e44eb790696 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.609165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e15123-1ed7-41d1-a49a-6e44eb790696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:54.609468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e15123-1ed7-41d1-a49a-6e44eb790696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:54.611610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e15123-1ed7-41d1-a49a-6e44eb790696 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:54.630863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 533/1049] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:54.630863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5aa97-53bb-4464-8c4a-b4a5a17e8fb2 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.630863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5aa97-53bb-4464-8c4a-b4a5a17e8fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.630863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5aa97-53bb-4464-8c4a-b4a5a17e8fb2 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.630863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 534/1050] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:54.632071 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5aa97-53bb-4464-8c4a-b4a5a17e8fb2 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.661499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82faf626-ca41-42bf-bb52-b125dda7620e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:54.662907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82faf626-ca41-42bf-bb52-b125dda7620e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:54.728558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5aa97-53bb-4464-8c4a-b4a5a17e8fb2 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.757730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 517/1051] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 14:56:54.759100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1d445-34f8-463d-be88-9dd9138a56ed None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.759386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1d445-34f8-463d-be88-9dd9138a56ed None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.759659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1d445-34f8-463d-be88-9dd9138a56ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.765039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00f9ca-86c1-4f98-a992-4b8f819dfe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.765680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00f9ca-86c1-4f98-a992-4b8f819dfe9b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.765962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00f9ca-86c1-4f98-a992-4b8f819dfe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.766262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00f9ca-86c1-4f98-a992-4b8f819dfe9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.767111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00f9ca-86c1-4f98-a992-4b8f819dfe9b None admin] RBAC: Adding query filter params (role.id=b3cef2ee2fdd4f48872310e2d4f0cc22, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=dc19a5d9ce774f39aa49ab7c64ba682e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:54.767538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00f9ca-86c1-4f98-a992-4b8f819dfe9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:54.768975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00f9ca-86c1-4f98-a992-4b8f819dfe9b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:54.786338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 535/1052] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/role_assignments?user.id=dc19a5d9ce774f39aa49ab7c64ba682e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=b3cef2ee2fdd4f48872310e2d4f0cc22 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:54.786338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00f9ca-86c1-4f98-a992-4b8f819dfe9b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.786701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b0a1d445-34f8-463d-be88-9dd9138a56ed None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:54.786701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b0a1d445-34f8-463d-be88-9dd9138a56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:54.849932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 518/1053] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:54.873476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1d445-34f8-463d-be88-9dd9138a56ed None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.895198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00f9ca-86c1-4f98-a992-4b8f819dfe9b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:54.933141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b066-fe0a-473e-a8c1-898fe6c43b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:54.933932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b066-fe0a-473e-a8c1-898fe6c43b1b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:54.934247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b066-fe0a-473e-a8c1-898fe6c43b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:54.934521 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b066-fe0a-473e-a8c1-898fe6c43b1b None admin] PATH_INFO: `/v3/projects/29dbe183839c4ab6885e1d189d853e27` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:54.935765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00b066-fe0a-473e-a8c1-898fe6c43b1b None admin] RBAC: Authorizing `identity:get_project(project_id=29dbe183839c4ab6885e1d189d853e27)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:54.937233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00b066-fe0a-473e-a8c1-898fe6c43b1b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:54.940022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 536/1054] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/projects/29dbe183839c4ab6885e1d189d853e27 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:54.945709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b066-fe0a-473e-a8c1-898fe6c43b1b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:54.982333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1d445-34f8-463d-be88-9dd9138a56ed None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:55.016118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a668-29b5-4708-a9dc-423bc05ea34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:55.016911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a668-29b5-4708-a9dc-423bc05ea34d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:55.017816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a668-29b5-4708-a9dc-423bc05ea34d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:55.018117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8a668-29b5-4708-a9dc-423bc05ea34d None admin] PATH_INFO: `/v3/services/image` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:55.018780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8a668-29b5-4708-a9dc-423bc05ea34d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:55.020151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8a668-29b5-4708-a9dc-423bc05ea34d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-bbf8a668-29b5-4708-a9dc-423bc05ea34d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:55.031562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:55.032749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:55.035114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 519/1055] 10.222.0.44 () {56 vars in 1105 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:55.038742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a668-29b5-4708-a9dc-423bc05ea34d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:55.060149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b066-fe0a-473e-a8c1-898fe6c43b1b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:55.093595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d355ab-542b-49bc-bb51-669ad2a68a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:55.094279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d355ab-542b-49bc-bb51-669ad2a68a73 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:55.094561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d355ab-542b-49bc-bb51-669ad2a68a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:55.094837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d355ab-542b-49bc-bb51-669ad2a68a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:55.096193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d355ab-542b-49bc-bb51-669ad2a68a73 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=29dbe183839c4ab6885e1d189d853e27, user.id=cbf836b409f14c37bd6a15decffcd432) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:55.096500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d355ab-542b-49bc-bb51-669ad2a68a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:55.097928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d355ab-542b-49bc-bb51-669ad2a68a73 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:55.103433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 537/1056] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:56:54 2022] GET /identity/v3/role_assignments?user.id=cbf836b409f14c37bd6a15decffcd432&scope.project.id=29dbe183839c4ab6885e1d189d853e27&role.id=042169a166e14a80beac826291ceaf73 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:55.142613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8a668-29b5-4708-a9dc-423bc05ea34d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:55.178900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae0c77-6314-4452-8437-5e07c17f3a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:55.179587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae0c77-6314-4452-8437-5e07c17f3a28 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:55.179872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae0c77-6314-4452-8437-5e07c17f3a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:55.180148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae0c77-6314-4452-8437-5e07c17f3a28 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:55.180868 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae0c77-6314-4452-8437-5e07c17f3a28 None admin] RBAC: Adding query filter params (name=image) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:55.181174 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae0c77-6314-4452-8437-5e07c17f3a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:55.182619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae0c77-6314-4452-8437-5e07c17f3a28 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:55.193373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 520/1057] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:55.194413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d355ab-542b-49bc-bb51-669ad2a68a73 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:55.295920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d355ab-542b-49bc-bb51-669ad2a68a73 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:55.328776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecd7e4-51a3-4ce4-84f7-5681a57d468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:55.335519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecd7e4-51a3-4ce4-84f7-5681a57d468c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:55.335519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecd7e4-51a3-4ce4-84f7-5681a57d468c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:55.335519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecd7e4-51a3-4ce4-84f7-5681a57d468c None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:55.335519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecd7e4-51a3-4ce4-84f7-5681a57d468c None admin] RBAC: Adding query filter params (type=image) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:55.335519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecd7e4-51a3-4ce4-84f7-5681a57d468c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:55.335519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecd7e4-51a3-4ce4-84f7-5681a57d468c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:55.337801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 538/1058] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:55.343774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae0c77-6314-4452-8437-5e07c17f3a28 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:55.440544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae0c77-6314-4452-8437-5e07c17f3a28 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:55.472677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b5dcc-776d-4f68-9934-a88cc3a25738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:55.473253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b5dcc-776d-4f68-9934-a88cc3a25738 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:55.473571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b5dcc-776d-4f68-9934-a88cc3a25738 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:55.473843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b5dcc-776d-4f68-9934-a88cc3a25738 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:55.474615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b5dcc-776d-4f68-9934-a88cc3a25738 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:55.475976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b5dcc-776d-4f68-9934-a88cc3a25738 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:55.565329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 521/1059] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 16 14:56:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:56:56.976542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67ea1e-4c3f-4d5e-9f37-c66cd17e8a63 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:56.977098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67ea1e-4c3f-4d5e-9f37-c66cd17e8a63 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:56.977098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67ea1e-4c3f-4d5e-9f37-c66cd17e8a63 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:56.978624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 539/1060] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:56.983647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda26a7-ffac-4d41-8699-894499378c9e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:56.984034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda26a7-ffac-4d41-8699-894499378c9e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:56.984202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda26a7-ffac-4d41-8699-894499378c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.002773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7dda26a7-ffac-4d41-8699-894499378c9e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:57.003944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7dda26a7-ffac-4d41-8699-894499378c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:57.080059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 522/1061] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:57.098144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67ea1e-4c3f-4d5e-9f37-c66cd17e8a63 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.199207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67ea1e-4c3f-4d5e-9f37-c66cd17e8a63 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:57.231120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9e963-65a2-4c43-b5d7-ec808b22e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:57.231847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e963-65a2-4c43-b5d7-ec808b22e8fd None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.232123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e963-65a2-4c43-b5d7-ec808b22e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.232392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e963-65a2-4c43-b5d7-ec808b22e8fd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.242979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9e963-65a2-4c43-b5d7-ec808b22e8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-84f9e963-65a2-4c43-b5d7-ec808b22e8fd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:57.250855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:57.251845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:56:57.252712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:57.254399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 540/1062] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:57.258156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda26a7-ffac-4d41-8699-894499378c9e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.319379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22367242-5d82-487f-96a1-9ad04c608a67 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.321500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22367242-5d82-487f-96a1-9ad04c608a67 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.321500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22367242-5d82-487f-96a1-9ad04c608a67 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.321500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 541/1063] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 14:56:57.326711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb475194-baec-4858-b95e-f7964f3b1ba1 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.326991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb475194-baec-4858-b95e-f7964f3b1ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.327256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb475194-baec-4858-b95e-f7964f3b1ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.344354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-fb475194-baec-4858-b95e-f7964f3b1ba1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:57.346031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fb475194-baec-4858-b95e-f7964f3b1ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:57.354454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda26a7-ffac-4d41-8699-894499378c9e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:57.387979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fba05-f9b9-4d6d-8daf-ac68c7b896c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:57.388670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fba05-f9b9-4d6d-8daf-ac68c7b896c2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.388946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fba05-f9b9-4d6d-8daf-ac68c7b896c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.389217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fba05-f9b9-4d6d-8daf-ac68c7b896c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.389965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fba05-f9b9-4d6d-8daf-ac68c7b896c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:57.390292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fba05-f9b9-4d6d-8daf-ac68c7b896c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:57.391651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fba05-f9b9-4d6d-8daf-ac68c7b896c2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:57.399718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 523/1064] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:57.405353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fba05-f9b9-4d6d-8daf-ac68c7b896c2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.424640 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 542/1065] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:56:57.441006 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb475194-baec-4858-b95e-f7964f3b1ba1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.501957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fba05-f9b9-4d6d-8daf-ac68c7b896c2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:57.532589 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb475194-baec-4858-b95e-f7964f3b1ba1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:57.534092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2e1b-c19f-4c97-b99e-2a237e8d19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:57.534886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2e1b-c19f-4c97-b99e-2a237e8d19a4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.535166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2e1b-c19f-4c97-b99e-2a237e8d19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.535440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2e1b-c19f-4c97-b99e-2a237e8d19a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.545561 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2e1b-c19f-4c97-b99e-2a237e8d19a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:57.547056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2e1b-c19f-4c97-b99e-2a237e8d19a4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b5ed2e1b-c19f-4c97-b99e-2a237e8d19a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:57.563884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:57.565031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:57.566170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:57.566170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:57.566170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:57.566170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:57.568685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb897db3-e7b3-4d1d-a0ed-71bfbfe648fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:57.569471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb897db3-e7b3-4d1d-a0ed-71bfbfe648fd None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.569940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb897db3-e7b3-4d1d-a0ed-71bfbfe648fd None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.570160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 524/1066] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:57.570269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb897db3-e7b3-4d1d-a0ed-71bfbfe648fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.570807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2e1b-c19f-4c97-b99e-2a237e8d19a4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.580712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb897db3-e7b3-4d1d-a0ed-71bfbfe648fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-bb897db3-e7b3-4d1d-a0ed-71bfbfe648fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:56:57.588211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:57.589158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:57.590327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 543/1067] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:57.596064 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb897db3-e7b3-4d1d-a0ed-71bfbfe648fd None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.674778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2e1b-c19f-4c97-b99e-2a237e8d19a4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:57.695018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb897db3-e7b3-4d1d-a0ed-71bfbfe648fd None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:57.707125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47741fb9-c329-4b8b-8f7a-cf343933f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:57.707791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47741fb9-c329-4b8b-8f7a-cf343933f424 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.708071 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47741fb9-c329-4b8b-8f7a-cf343933f424 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.708348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47741fb9-c329-4b8b-8f7a-cf343933f424 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.709058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47741fb9-c329-4b8b-8f7a-cf343933f424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:57.709365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47741fb9-c329-4b8b-8f7a-cf343933f424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:57.710759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47741fb9-c329-4b8b-8f7a-cf343933f424 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:57.722984 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 525/1068] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:57.728233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f0a76-5dd7-4dc0-ae72-a5d45b1f6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:57.728373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47741fb9-c329-4b8b-8f7a-cf343933f424 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.728891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f0a76-5dd7-4dc0-ae72-a5d45b1f6945 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.729173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f0a76-5dd7-4dc0-ae72-a5d45b1f6945 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.729442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f0a76-5dd7-4dc0-ae72-a5d45b1f6945 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.730209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f0a76-5dd7-4dc0-ae72-a5d45b1f6945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:57.730569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f0a76-5dd7-4dc0-ae72-a5d45b1f6945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:57.732112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f0a76-5dd7-4dc0-ae72-a5d45b1f6945 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:57.746694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 544/1069] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:57.747968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f0a76-5dd7-4dc0-ae72-a5d45b1f6945 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.823316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47741fb9-c329-4b8b-8f7a-cf343933f424 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:57.841482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f0a76-5dd7-4dc0-ae72-a5d45b1f6945 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:57.855385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47c5be-5aea-42d2-80b0-d20260b5d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:57.856156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47c5be-5aea-42d2-80b0-d20260b5d00e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.856431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47c5be-5aea-42d2-80b0-d20260b5d00e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.856697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47c5be-5aea-42d2-80b0-d20260b5d00e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.863586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47c5be-5aea-42d2-80b0-d20260b5d00e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:57.865030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47c5be-5aea-42d2-80b0-d20260b5d00e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:57.873707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec55b3-dd48-46ae-885c-7e578dba8b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:57.874630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec55b3-dd48-46ae-885c-7e578dba8b00 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.874913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec55b3-dd48-46ae-885c-7e578dba8b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.875181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec55b3-dd48-46ae-885c-7e578dba8b00 None admin] PATH_INFO: `/v3/users/cbf836b409f14c37bd6a15decffcd432` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.876363 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec55b3-dd48-46ae-885c-7e578dba8b00 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf836b409f14c37bd6a15decffcd432)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:57.877799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec55b3-dd48-46ae-885c-7e578dba8b00 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-be47c5be-5aea-42d2-80b0-d20260b5d00e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:56:57.879370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:57.880322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:56:57.881277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:57.881869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 545/1070] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/users/cbf836b409f14c37bd6a15decffcd432 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:57.881940 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 526/1071] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:57.885087 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47c5be-5aea-42d2-80b0-d20260b5d00e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.885509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a7f7-b5f3-4b77-9438-322c5d20f041 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:57.885804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a7f7-b5f3-4b77-9438-322c5d20f041 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:57.886104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a7f7-b5f3-4b77-9438-322c5d20f041 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:57.887381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 546/1072] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:56:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:56:57.888084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a7f7-b5f3-4b77-9438-322c5d20f041 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:57.976692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47c5be-5aea-42d2-80b0-d20260b5d00e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:57.982432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a7f7-b5f3-4b77-9438-322c5d20f041 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.008627 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bc484-d53b-43d6-9f20-8764b4b79dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.009483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bc484-d53b-43d6-9f20-8764b4b79dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.009763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bc484-d53b-43d6-9f20-8764b4b79dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.010035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bc484-d53b-43d6-9f20-8764b4b79dc5 None admin] PATH_INFO: `/v3/projects/29dbe183839c4ab6885e1d189d853e27` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.011234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bc484-d53b-43d6-9f20-8764b4b79dc5 None admin] RBAC: Authorizing `identity:get_project(project_id=29dbe183839c4ab6885e1d189d853e27)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.012658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bc484-d53b-43d6-9f20-8764b4b79dc5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.014389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 527/1073] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/projects/29dbe183839c4ab6885e1d189d853e27 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:58.014535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40366bc5-6830-410f-87d6-54563ce83ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.015115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40366bc5-6830-410f-87d6-54563ce83ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.015473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40366bc5-6830-410f-87d6-54563ce83ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.015572 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0884aac-078d-47f4-bb6a-35107c1d4265 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.015750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40366bc5-6830-410f-87d6-54563ce83ff5 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.015862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0884aac-078d-47f4-bb6a-35107c1d4265 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.016036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0884aac-078d-47f4-bb6a-35107c1d4265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.016585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40366bc5-6830-410f-87d6-54563ce83ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:58.016891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40366bc5-6830-410f-87d6-54563ce83ff5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.018893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40366bc5-6830-410f-87d6-54563ce83ff5 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.032451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a0884aac-078d-47f4-bb6a-35107c1d4265 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:56:58.033614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a0884aac-078d-47f4-bb6a-35107c1d4265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:56:58.035503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 547/1074] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 16 14:56:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:58.036273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40366bc5-6830-410f-87d6-54563ce83ff5 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:58.097869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 528/1075] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:56:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:56:58.098749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0884aac-078d-47f4-bb6a-35107c1d4265 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:58.128700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40366bc5-6830-410f-87d6-54563ce83ff5 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.160458 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4990-2559-4d47-9970-64afe5212b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.161322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4990-2559-4d47-9970-64afe5212b34 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.161599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4990-2559-4d47-9970-64afe5212b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.161868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4990-2559-4d47-9970-64afe5212b34 None admin] PATH_INFO: `/v3/projects/29dbe183839c4ab6885e1d189d853e27/users/cbf836b409f14c37bd6a15decffcd432/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.163929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4990-2559-4d47-9970-64afe5212b34 None admin] RBAC: Authorizing `identity:create_grant(project_id=29dbe183839c4ab6885e1d189d853e27, user_id=cbf836b409f14c37bd6a15decffcd432, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.165514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4990-2559-4d47-9970-64afe5212b34 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.190579 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0884aac-078d-47f4-bb6a-35107c1d4265 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.222623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f9f9e-2d04-4939-bc64-4c61631d064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.223394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f9f9e-2d04-4939-bc64-4c61631d064c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.223671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f9f9e-2d04-4939-bc64-4c61631d064c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.223941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f9f9e-2d04-4939-bc64-4c61631d064c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.233290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f9f9e-2d04-4939-bc64-4c61631d064c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.234745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f9f9e-2d04-4939-bc64-4c61631d064c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-a60f9f9e-2d04-4939-bc64-4c61631d064c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:58.252505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:58.253530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:58.254530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:58.254530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:58.254530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:58.254530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:58.254530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 529/1076] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:56:58.254530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f9f9e-2d04-4939-bc64-4c61631d064c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:58.268439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 548/1077] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:58 2022] PUT /identity/v3/projects/29dbe183839c4ab6885e1d189d853e27/users/cbf836b409f14c37bd6a15decffcd432/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:56:58.269365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4990-2559-4d47-9970-64afe5212b34 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:58.360337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f9f9e-2d04-4939-bc64-4c61631d064c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.372250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4990-2559-4d47-9970-64afe5212b34 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.397096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8df959-e336-473e-a14f-956b02198af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.397764 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8df959-e336-473e-a14f-956b02198af9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.398067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8df959-e336-473e-a14f-956b02198af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.398355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8df959-e336-473e-a14f-956b02198af9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.406671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcc98e-a48a-4117-aabd-f4cc2d4a8f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.407606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcc98e-a48a-4117-aabd-f4cc2d4a8f42 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.408087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcc98e-a48a-4117-aabd-f4cc2d4a8f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.408505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcc98e-a48a-4117-aabd-f4cc2d4a8f42 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.409399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcc98e-a48a-4117-aabd-f4cc2d4a8f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:58.409893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcc98e-a48a-4117-aabd-f4cc2d4a8f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.411322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcc98e-a48a-4117-aabd-f4cc2d4a8f42 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.423080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 549/1078] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:58.429948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcc98e-a48a-4117-aabd-f4cc2d4a8f42 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:58.474768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8df959-e336-473e-a14f-956b02198af9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.476238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8df959-e336-473e-a14f-956b02198af9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.538088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcc98e-a48a-4117-aabd-f4cc2d4a8f42 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.569734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da927-ef4d-4602-b960-95b504712175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.575220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 530/1079] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:56:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:56:58.575347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da927-ef4d-4602-b960-95b504712175 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.575347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da927-ef4d-4602-b960-95b504712175 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.575347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da927-ef4d-4602-b960-95b504712175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.575972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8df959-e336-473e-a14f-956b02198af9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:58.577744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da927-ef4d-4602-b960-95b504712175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.579219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da927-ef4d-4602-b960-95b504712175 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-199da927-ef4d-4602-b960-95b504712175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:56:58.594423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:58.595970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:58.596906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:56:58.596906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:56:58.596906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:56:58.596906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:56:58.596906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:56:58.596906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:56:58.596906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:56:58.596906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:56:58.596906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 550/1080] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:58.601823 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da927-ef4d-4602-b960-95b504712175 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:58.675121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8df959-e336-473e-a14f-956b02198af9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.699131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da927-ef4d-4602-b960-95b504712175 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.715365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40c7b-a335-4e5a-903b-1a8fb96a0921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.716521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40c7b-a335-4e5a-903b-1a8fb96a0921 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.716999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40c7b-a335-4e5a-903b-1a8fb96a0921 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.717467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40c7b-a335-4e5a-903b-1a8fb96a0921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.727916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d40c7b-a335-4e5a-903b-1a8fb96a0921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.729594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d40c7b-a335-4e5a-903b-1a8fb96a0921 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.732261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc4ae9-971d-4aaa-b84e-4d49a711bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.732916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc4ae9-971d-4aaa-b84e-4d49a711bdfd None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.733192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc4ae9-971d-4aaa-b84e-4d49a711bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.733459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc4ae9-971d-4aaa-b84e-4d49a711bdfd None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.734260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc4ae9-971d-4aaa-b84e-4d49a711bdfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:58.734565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc4ae9-971d-4aaa-b84e-4d49a711bdfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.736583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc4ae9-971d-4aaa-b84e-4d49a711bdfd None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.747492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 551/1081] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f9d40c7b-a335-4e5a-903b-1a8fb96a0921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:56:58.749104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:56:58.750077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:56:58.753787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:56:58.753787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:56:58.753787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:56:58.753787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:56:58.753787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 531/1082] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:56:58.755910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40c7b-a335-4e5a-903b-1a8fb96a0921 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:58.756028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc4ae9-971d-4aaa-b84e-4d49a711bdfd None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:56:58.850365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40c7b-a335-4e5a-903b-1a8fb96a0921 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.854622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc4ae9-971d-4aaa-b84e-4d49a711bdfd None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:56:58.883191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b059ed-4e61-4866-8148-d6a7d656d7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.883844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b059ed-4e61-4866-8148-d6a7d656d7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.884120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b059ed-4e61-4866-8148-d6a7d656d7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.884384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b059ed-4e61-4866-8148-d6a7d656d7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.885086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b059ed-4e61-4866-8148-d6a7d656d7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:56:58.885385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b059ed-4e61-4866-8148-d6a7d656d7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.886765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b059ed-4e61-4866-8148-d6a7d656d7f3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.890277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac4749-c5b9-4949-9788-7782d2d01690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:56:58.891155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4749-c5b9-4949-9788-7782d2d01690 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:56:58.891430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4749-c5b9-4949-9788-7782d2d01690 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:56:58.891698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4749-c5b9-4949-9788-7782d2d01690 None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/dc19a5d9ce774f39aa49ab7c64ba682e/roles/b3cef2ee2fdd4f48872310e2d4f0cc22` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:56:58.893947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac4749-c5b9-4949-9788-7782d2d01690 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=dc19a5d9ce774f39aa49ab7c64ba682e, role_id=b3cef2ee2fdd4f48872310e2d4f0cc22)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:56:58.895391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac4749-c5b9-4949-9788-7782d2d01690 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:56:58.910196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 532/1083] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:56:58.976411 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 552/1084] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:56:58 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/dc19a5d9ce774f39aa49ab7c64ba682e/roles/b3cef2ee2fdd4f48872310e2d4f0cc22 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:57:00.503197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aa346-ef80-449d-a903-499c562a7d6f None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:00.503732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aa346-ef80-449d-a903-499c562a7d6f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:00.503732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aa346-ef80-449d-a903-499c562a7d6f None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:00.505024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 533/1085] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:00.510261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25f2c6-f69a-40cf-8d2f-b5498adc7e11 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:00.510659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25f2c6-f69a-40cf-8d2f-b5498adc7e11 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:00.510834 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25f2c6-f69a-40cf-8d2f-b5498adc7e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:00.527558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ff25f2c6-f69a-40cf-8d2f-b5498adc7e11 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:00.528731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ff25f2c6-f69a-40cf-8d2f-b5498adc7e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:00.590849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 553/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:00.614311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aa346-ef80-449d-a903-499c562a7d6f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:00.710190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aa346-ef80-449d-a903-499c562a7d6f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:00.741849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf907395-8f30-49a4-8f8d-f9b53cde4c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:00.742655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf907395-8f30-49a4-8f8d-f9b53cde4c29 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:00.742937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf907395-8f30-49a4-8f8d-f9b53cde4c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:00.743205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf907395-8f30-49a4-8f8d-f9b53cde4c29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:00.753844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf907395-8f30-49a4-8f8d-f9b53cde4c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-cf907395-8f30-49a4-8f8d-f9b53cde4c29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:57:00.761247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:00.762393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:00.768177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 534/1087] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:00.768887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25f2c6-f69a-40cf-8d2f-b5498adc7e11 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:00.861838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25f2c6-f69a-40cf-8d2f-b5498adc7e11 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:00.893278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c297e9-8c59-47ad-9b3d-a7bdb49bd922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:00.893937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c297e9-8c59-47ad-9b3d-a7bdb49bd922 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:00.894248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c297e9-8c59-47ad-9b3d-a7bdb49bd922 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:00.894519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c297e9-8c59-47ad-9b3d-a7bdb49bd922 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:00.895251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c297e9-8c59-47ad-9b3d-a7bdb49bd922 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:00.895551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c297e9-8c59-47ad-9b3d-a7bdb49bd922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:00.896903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c297e9-8c59-47ad-9b3d-a7bdb49bd922 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:00.904523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 554/1088] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:57:00.910155 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf907395-8f30-49a4-8f8d-f9b53cde4c29 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:01.006486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf907395-8f30-49a4-8f8d-f9b53cde4c29 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:01.041085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea6e95-d907-453c-82bb-5011badb1892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:01.041972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea6e95-d907-453c-82bb-5011badb1892 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.042280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea6e95-d907-453c-82bb-5011badb1892 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.042548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea6e95-d907-453c-82bb-5011badb1892 None admin] PATH_INFO: `/v3/users/cbf836b409f14c37bd6a15decffcd432` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.043793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea6e95-d907-453c-82bb-5011badb1892 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf836b409f14c37bd6a15decffcd432)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:01.045256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea6e95-d907-453c-82bb-5011badb1892 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:01.047000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 535/1089] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:00 2022] GET /identity/v3/users/cbf836b409f14c37bd6a15decffcd432 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:01.053650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c297e9-8c59-47ad-9b3d-a7bdb49bd922 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:01.147898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c297e9-8c59-47ad-9b3d-a7bdb49bd922 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:01.179360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151e1a-d5f6-4c93-a6a8-aa0c5bcc19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:01.180004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151e1a-d5f6-4c93-a6a8-aa0c5bcc19bf None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.180313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151e1a-d5f6-4c93-a6a8-aa0c5bcc19bf None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.180589 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151e1a-d5f6-4c93-a6a8-aa0c5bcc19bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.208924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24f928-9081-453a-8357-851896e1b239 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.209216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24f928-9081-453a-8357-851896e1b239 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.209489 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24f928-9081-453a-8357-851896e1b239 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.210888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 536/1090] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:01.215988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aee760-3fb3-431b-8358-09eed56c3f9c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.216269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aee760-3fb3-431b-8358-09eed56c3f9c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.216540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aee760-3fb3-431b-8358-09eed56c3f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.235223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-19aee760-3fb3-431b-8358-09eed56c3f9c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:01.236442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-19aee760-3fb3-431b-8358-09eed56c3f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:01.244535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33151e1a-d5f6-4c93-a6a8-aa0c5bcc19bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:01.245968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33151e1a-d5f6-4c93-a6a8-aa0c5bcc19bf None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:01.300271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 537/1091] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:57:01.324350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aee760-3fb3-431b-8358-09eed56c3f9c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:01.340343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 555/1092] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:57:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:57:01.346178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151e1a-d5f6-4c93-a6a8-aa0c5bcc19bf None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:01.416293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aee760-3fb3-431b-8358-09eed56c3f9c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:01.437271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151e1a-d5f6-4c93-a6a8-aa0c5bcc19bf None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:01.449054 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aabcad-9207-4b39-ad5a-44579575ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:01.449854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aabcad-9207-4b39-ad5a-44579575ccee None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.450161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aabcad-9207-4b39-ad5a-44579575ccee None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.450437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aabcad-9207-4b39-ad5a-44579575ccee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.460079 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aabcad-9207-4b39-ad5a-44579575ccee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-83aabcad-9207-4b39-ad5a-44579575ccee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:57:01.468367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:01.471973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:01.472838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 538/1093] 10.222.0.44 () {56 vars in 1120 bytes} [Mon May 16 14:57:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:57:01.473531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4055878-ba4c-4af4-bc8a-a07551d2fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:01.473531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055878-ba4c-4af4-bc8a-a07551d2fae0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.473531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055878-ba4c-4af4-bc8a-a07551d2fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.473531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055878-ba4c-4af4-bc8a-a07551d2fae0 None admin] PATH_INFO: `/v3/projects/29dbe183839c4ab6885e1d189d853e27` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.473798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4055878-ba4c-4af4-bc8a-a07551d2fae0 None admin] RBAC: Authorizing `identity:get_project(project_id=29dbe183839c4ab6885e1d189d853e27)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:01.474983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4055878-ba4c-4af4-bc8a-a07551d2fae0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:01.475747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aabcad-9207-4b39-ad5a-44579575ccee None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:01.481391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 556/1094] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:01 2022] GET /identity/v3/projects/29dbe183839c4ab6885e1d189d853e27 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:57:01.482357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4055878-ba4c-4af4-bc8a-a07551d2fae0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:01.570109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aabcad-9207-4b39-ad5a-44579575ccee None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:01.575810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4055878-ba4c-4af4-bc8a-a07551d2fae0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:01.601261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cad89-86e0-4e62-ad43-b7badb54aebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:01.601928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cad89-86e0-4e62-ad43-b7badb54aebe None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.602236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cad89-86e0-4e62-ad43-b7badb54aebe None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.602512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cad89-86e0-4e62-ad43-b7badb54aebe None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.603242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cad89-86e0-4e62-ad43-b7badb54aebe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:01.603546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cad89-86e0-4e62-ad43-b7badb54aebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:01.604915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cad89-86e0-4e62-ad43-b7badb54aebe None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:01.607443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7d3a-708b-4ef0-abd3-8b17c4465ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:01.608081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7d3a-708b-4ef0-abd3-8b17c4465ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.608360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7d3a-708b-4ef0-abd3-8b17c4465ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.608630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7d3a-708b-4ef0-abd3-8b17c4465ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.609469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7d3a-708b-4ef0-abd3-8b17c4465ea1 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=29dbe183839c4ab6885e1d189d853e27, user.id=cbf836b409f14c37bd6a15decffcd432) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:01.609828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7d3a-708b-4ef0-abd3-8b17c4465ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:01.611803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7d3a-708b-4ef0-abd3-8b17c4465ea1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:01.613253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 539/1095] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 16 14:57:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:57:01.618108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 557/1096] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:57:01 2022] GET /identity/v3/role_assignments?user.id=cbf836b409f14c37bd6a15decffcd432&scope.project.id=29dbe183839c4ab6885e1d189d853e27&role.id=042169a166e14a80beac826291ceaf73 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:01.621729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cad89-86e0-4e62-ad43-b7badb54aebe None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:01.725191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cad89-86e0-4e62-ad43-b7badb54aebe None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:01.759303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd888-d283-42d3-98f4-2c0ad3cae0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:01.760092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd888-d283-42d3-98f4-2c0ad3cae0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.760373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd888-d283-42d3-98f4-2c0ad3cae0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.760645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd888-d283-42d3-98f4-2c0ad3cae0b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.772698 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd888-d283-42d3-98f4-2c0ad3cae0b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:01.774196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd888-d283-42d3-98f4-2c0ad3cae0b8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f44fd888-d283-42d3-98f4-2c0ad3cae0b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:57:01.792158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:01.793151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:01.794078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:57:01.794078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:57:01.794078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:57:01.794078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:01.794078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 540/1097] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:57:01.799737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7d3a-708b-4ef0-abd3-8b17c4465ea1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:01.896743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7d3a-708b-4ef0-abd3-8b17c4465ea1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:01.928699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6421955-7a72-4379-9b7f-0e61c250f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:01.929443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6421955-7a72-4379-9b7f-0e61c250f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:01.929722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6421955-7a72-4379-9b7f-0e61c250f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:01.929991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6421955-7a72-4379-9b7f-0e61c250f6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:01.930731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6421955-7a72-4379-9b7f-0e61c250f6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:01.931031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6421955-7a72-4379-9b7f-0e61c250f6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:01.932380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6421955-7a72-4379-9b7f-0e61c250f6f1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:01.943211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 558/1098] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:57:01.948886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd888-d283-42d3-98f4-2c0ad3cae0b8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:02.044811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd888-d283-42d3-98f4-2c0ad3cae0b8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:02.077686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7753ec8-310f-4820-af7c-6ae122f57038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:02.078528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753ec8-310f-4820-af7c-6ae122f57038 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:02.078814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753ec8-310f-4820-af7c-6ae122f57038 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:02.079586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753ec8-310f-4820-af7c-6ae122f57038 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:02.087385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7753ec8-310f-4820-af7c-6ae122f57038 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:02.088822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7753ec8-310f-4820-af7c-6ae122f57038 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f7753ec8-310f-4820-af7c-6ae122f57038 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:57:02.103310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:02.104500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:02.105448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 541/1099] 10.222.0.44 () {56 vars in 1093 bytes} [Mon May 16 14:57:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:02.110205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6421955-7a72-4379-9b7f-0e61c250f6f1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:02.205487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6421955-7a72-4379-9b7f-0e61c250f6f1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:02.237836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b0a3-f25e-47ed-ae8c-03c5efb72092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:02.238556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b0a3-f25e-47ed-ae8c-03c5efb72092 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:02.238838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b0a3-f25e-47ed-ae8c-03c5efb72092 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:02.239109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b0a3-f25e-47ed-ae8c-03c5efb72092 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:02.239940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b0a3-f25e-47ed-ae8c-03c5efb72092 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:02.240249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b0a3-f25e-47ed-ae8c-03c5efb72092 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:02.241667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b0a3-f25e-47ed-ae8c-03c5efb72092 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:02.258143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 559/1100] 10.222.0.44 () {56 vars in 1133 bytes} [Mon May 16 14:57:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:02.263826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7753ec8-310f-4820-af7c-6ae122f57038 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:02.357969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7753ec8-310f-4820-af7c-6ae122f57038 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:02.390045 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740067e-d79b-472a-8697-6106591a6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:02.390715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740067e-d79b-472a-8697-6106591a6c88 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:02.390998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740067e-d79b-472a-8697-6106591a6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:02.391273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740067e-d79b-472a-8697-6106591a6c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:02.455111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740067e-d79b-472a-8697-6106591a6c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:02.456610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740067e-d79b-472a-8697-6106591a6c88 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:02.551452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 542/1101] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:57:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:57:02.557265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b0a3-f25e-47ed-ae8c-03c5efb72092 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:02.650529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b0a3-f25e-47ed-ae8c-03c5efb72092 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:02.683833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e848186-900f-425d-a2db-5ea5e8a45388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:02.684604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848186-900f-425d-a2db-5ea5e8a45388 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:02.684884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848186-900f-425d-a2db-5ea5e8a45388 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:02.685180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e848186-900f-425d-a2db-5ea5e8a45388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:02.694828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e848186-900f-425d-a2db-5ea5e8a45388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:02.696259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e848186-900f-425d-a2db-5ea5e8a45388 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-8e848186-900f-425d-a2db-5ea5e8a45388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:57:02.713136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:02.714034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:02.715575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:57:02.715575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:57:02.715575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:57:02.715575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:57:02.715575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 560/1102] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:02.722171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740067e-d79b-472a-8697-6106591a6c88 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:02.817709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740067e-d79b-472a-8697-6106591a6c88 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:02.851155 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267e610-abf4-452c-84fa-804cc59f9399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:02.851810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267e610-abf4-452c-84fa-804cc59f9399 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:02.852089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267e610-abf4-452c-84fa-804cc59f9399 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:02.852365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267e610-abf4-452c-84fa-804cc59f9399 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:02.853075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267e610-abf4-452c-84fa-804cc59f9399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:02.853376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267e610-abf4-452c-84fa-804cc59f9399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:02.854765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267e610-abf4-452c-84fa-804cc59f9399 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:02.865561 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 543/1103] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:02.871137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e848186-900f-425d-a2db-5ea5e8a45388 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:02.970384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e848186-900f-425d-a2db-5ea5e8a45388 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:03.001661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b5ea3-fc44-4e76-867f-032bece28125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:03.002471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5ea3-fc44-4e76-867f-032bece28125 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:03.002748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5ea3-fc44-4e76-867f-032bece28125 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:03.003017 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5ea3-fc44-4e76-867f-032bece28125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:03.009500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b5ea3-fc44-4e76-867f-032bece28125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:03.010970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b5ea3-fc44-4e76-867f-032bece28125 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-d14b5ea3-fc44-4e76-867f-032bece28125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:57:03.025103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:03.026167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:03.027093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:57:03.027093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:57:03.027093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:57:03.027093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:57:03.027093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:57:03.027093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:57:03.027093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:57:03.027093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:57:03.027093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 561/1104] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:03.031973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267e610-abf4-452c-84fa-804cc59f9399 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:03.130064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267e610-abf4-452c-84fa-804cc59f9399 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:03.161961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec6d3a-6f41-4931-95c6-f2b5a095f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:03.162665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec6d3a-6f41-4931-95c6-f2b5a095f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:03.162947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec6d3a-6f41-4931-95c6-f2b5a095f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:03.163223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec6d3a-6f41-4931-95c6-f2b5a095f8d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:03.164006 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec6d3a-6f41-4931-95c6-f2b5a095f8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:03.164315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec6d3a-6f41-4931-95c6-f2b5a095f8d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:03.165740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec6d3a-6f41-4931-95c6-f2b5a095f8d1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:03.177354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 544/1105] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:03.183293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b5ea3-fc44-4e76-867f-032bece28125 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:03.277210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b5ea3-fc44-4e76-867f-032bece28125 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:03.308377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541e84f-b40a-4d01-849c-8382b1d13e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:03.309023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e84f-b40a-4d01-849c-8382b1d13e1f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:03.309306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e84f-b40a-4d01-849c-8382b1d13e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:03.309583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e84f-b40a-4d01-849c-8382b1d13e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:03.310443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541e84f-b40a-4d01-849c-8382b1d13e1f None admin] RBAC: Adding query filter params (role.id=b3cef2ee2fdd4f48872310e2d4f0cc22, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=dc19a5d9ce774f39aa49ab7c64ba682e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:03.310756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541e84f-b40a-4d01-849c-8382b1d13e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:03.312186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541e84f-b40a-4d01-849c-8382b1d13e1f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:03.318440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 562/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:57:03 2022] GET /identity/v3/role_assignments?user.id=dc19a5d9ce774f39aa49ab7c64ba682e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=b3cef2ee2fdd4f48872310e2d4f0cc22 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:57:03.862544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4045d7-e662-4aed-bd63-5b355377f2ef None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:03.863077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4045d7-e662-4aed-bd63-5b355377f2ef None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:03.863077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4045d7-e662-4aed-bd63-5b355377f2ef None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:03.864466 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 545/1107] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:03.869869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ade2bf-7e76-4dc5-843f-c2694804a077 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:03.870316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ade2bf-7e76-4dc5-843f-c2694804a077 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:03.870476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ade2bf-7e76-4dc5-843f-c2694804a077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:03.888002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d2ade2bf-7e76-4dc5-843f-c2694804a077 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:03.889193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d2ade2bf-7e76-4dc5-843f-c2694804a077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:03.963745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 563/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:03.989416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4045d7-e662-4aed-bd63-5b355377f2ef None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:04.088209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4045d7-e662-4aed-bd63-5b355377f2ef None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:04.122371 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af829706-a939-4e20-acb6-a872eb9e6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:04.123085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af829706-a939-4e20-acb6-a872eb9e6aec None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:04.123370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af829706-a939-4e20-acb6-a872eb9e6aec None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:04.123641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af829706-a939-4e20-acb6-a872eb9e6aec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:04.124824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af829706-a939-4e20-acb6-a872eb9e6aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:04.126324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af829706-a939-4e20-acb6-a872eb9e6aec None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:04.127995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 546/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:57:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:04.133933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ade2bf-7e76-4dc5-843f-c2694804a077 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:04.229824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ade2bf-7e76-4dc5-843f-c2694804a077 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:04.261014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc53466-a371-4ad1-91f8-f70916f59170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:04.261668 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc53466-a371-4ad1-91f8-f70916f59170 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:04.261946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc53466-a371-4ad1-91f8-f70916f59170 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:04.262247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc53466-a371-4ad1-91f8-f70916f59170 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:04.262954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc53466-a371-4ad1-91f8-f70916f59170 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:04.264366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc53466-a371-4ad1-91f8-f70916f59170 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:04.353603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 564/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:57:04 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:57:06.574282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18961b4e-8635-4f00-bae6-f63ba5bbe869 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:06.574828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18961b4e-8635-4f00-bae6-f63ba5bbe869 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:06.574828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18961b4e-8635-4f00-bae6-f63ba5bbe869 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:06.576199 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 547/1111] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:06.581911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a65fa-d484-4757-9e90-13574d7a60b9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:06.582307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a65fa-d484-4757-9e90-13574d7a60b9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:06.582493 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a65fa-d484-4757-9e90-13574d7a60b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:06.599296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2b5a65fa-d484-4757-9e90-13574d7a60b9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:06.600465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2b5a65fa-d484-4757-9e90-13574d7a60b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:06.660784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 565/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:57:06.683081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18961b4e-8635-4f00-bae6-f63ba5bbe869 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:06.777226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18961b4e-8635-4f00-bae6-f63ba5bbe869 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:06.808518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dca60c-b24f-4b56-b96d-b5e6d39f5ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:06.809345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dca60c-b24f-4b56-b96d-b5e6d39f5ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:06.809623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dca60c-b24f-4b56-b96d-b5e6d39f5ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:06.809892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dca60c-b24f-4b56-b96d-b5e6d39f5ac2 None admin] PATH_INFO: `/v3/roles/638115ca27864c64a0554c5c0913956a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:06.811373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dca60c-b24f-4b56-b96d-b5e6d39f5ac2 None admin] RBAC: Authorizing `identity:get_role(role_id=638115ca27864c64a0554c5c0913956a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:06.812727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dca60c-b24f-4b56-b96d-b5e6d39f5ac2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:06.814096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 548/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:06 2022] GET /identity/v3/roles/638115ca27864c64a0554c5c0913956a => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:06.819694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a65fa-d484-4757-9e90-13574d7a60b9 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:06.912094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a65fa-d484-4757-9e90-13574d7a60b9 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:06.943510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a3cb4-f24f-4609-a4fb-b72521f9a745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:06.944384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a3cb4-f24f-4609-a4fb-b72521f9a745 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:06.944659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a3cb4-f24f-4609-a4fb-b72521f9a745 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:06.944924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a3cb4-f24f-4609-a4fb-b72521f9a745 None admin] PATH_INFO: `/v3/users/4b768c2338334f4cb9de7fb944416449` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:06.957677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a3cb4-f24f-4609-a4fb-b72521f9a745 None admin] RBAC: Authorizing `identity:get_user(user_id=4b768c2338334f4cb9de7fb944416449)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:06.959131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a3cb4-f24f-4609-a4fb-b72521f9a745 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:06.960744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 566/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:06 2022] GET /identity/v3/users/4b768c2338334f4cb9de7fb944416449 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:06.966719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dca60c-b24f-4b56-b96d-b5e6d39f5ac2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:07.059681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dca60c-b24f-4b56-b96d-b5e6d39f5ac2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:07.092333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37a810-6a17-4e07-a11a-6321a2422346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:07.092972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37a810-6a17-4e07-a11a-6321a2422346 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:07.093252 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37a810-6a17-4e07-a11a-6321a2422346 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:07.093523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37a810-6a17-4e07-a11a-6321a2422346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:07.155375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37a810-6a17-4e07-a11a-6321a2422346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:07.156803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37a810-6a17-4e07-a11a-6321a2422346 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:07.246431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 549/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:57:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:57:07.252752 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a3cb4-f24f-4609-a4fb-b72521f9a745 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:07.344891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a3cb4-f24f-4609-a4fb-b72521f9a745 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:07.376388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12d5df-598d-44ef-9169-db6a0eacb272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:07.377762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d5df-598d-44ef-9169-db6a0eacb272 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:07.378039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d5df-598d-44ef-9169-db6a0eacb272 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:07.378341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d5df-598d-44ef-9169-db6a0eacb272 None admin] PATH_INFO: `/v3/projects/29dbe183839c4ab6885e1d189d853e27` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:07.379507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12d5df-598d-44ef-9169-db6a0eacb272 None admin] RBAC: Authorizing `identity:get_project(project_id=29dbe183839c4ab6885e1d189d853e27)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:07.380926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12d5df-598d-44ef-9169-db6a0eacb272 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:07.382630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 567/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:07 2022] GET /identity/v3/projects/29dbe183839c4ab6885e1d189d853e27 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:07.388783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37a810-6a17-4e07-a11a-6321a2422346 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:07.481018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37a810-6a17-4e07-a11a-6321a2422346 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:07.514022 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827eebf9-8b09-4502-8e49-962351ad3fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:07.514627 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827eebf9-8b09-4502-8e49-962351ad3fed None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:07.514905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827eebf9-8b09-4502-8e49-962351ad3fed None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:07.515176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827eebf9-8b09-4502-8e49-962351ad3fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:07.515982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827eebf9-8b09-4502-8e49-962351ad3fed None admin] RBAC: Adding query filter params (role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=29dbe183839c4ab6885e1d189d853e27, user.id=4b768c2338334f4cb9de7fb944416449) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:07.516287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827eebf9-8b09-4502-8e49-962351ad3fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:07.517815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827eebf9-8b09-4502-8e49-962351ad3fed None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:07.523132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 550/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:57:07 2022] GET /identity/v3/role_assignments?user.id=4b768c2338334f4cb9de7fb944416449&scope.project.id=29dbe183839c4ab6885e1d189d853e27&role.id=638115ca27864c64a0554c5c0913956a => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:09.672262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6732d5-f554-4034-b981-2224c1cb254d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:09.672788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6732d5-f554-4034-b981-2224c1cb254d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:09.672788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6732d5-f554-4034-b981-2224c1cb254d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:09.674325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 568/1118] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:09.679441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf5c9a-b73b-4959-9f21-e57331a7af0a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:09.679929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf5c9a-b73b-4959-9f21-e57331a7af0a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:09.680012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf5c9a-b73b-4959-9f21-e57331a7af0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:09.696046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ebbf5c9a-b73b-4959-9f21-e57331a7af0a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:09.697201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ebbf5c9a-b73b-4959-9f21-e57331a7af0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:09.759281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 551/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:09.781376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6732d5-f554-4034-b981-2224c1cb254d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:09.875507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6732d5-f554-4034-b981-2224c1cb254d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:09.906901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc22c81-6ba2-48ae-bf0c-bb4b3640a6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:09.907731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22c81-6ba2-48ae-bf0c-bb4b3640a6ea None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:09.908616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22c81-6ba2-48ae-bf0c-bb4b3640a6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:09.908886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22c81-6ba2-48ae-bf0c-bb4b3640a6ea None admin] PATH_INFO: `/v3/roles/638115ca27864c64a0554c5c0913956a` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:09.910354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc22c81-6ba2-48ae-bf0c-bb4b3640a6ea None admin] RBAC: Authorizing `identity:get_role(role_id=638115ca27864c64a0554c5c0913956a)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:09.911707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc22c81-6ba2-48ae-bf0c-bb4b3640a6ea None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:09.913049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 569/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:09 2022] GET /identity/v3/roles/638115ca27864c64a0554c5c0913956a => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:09.918704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf5c9a-b73b-4959-9f21-e57331a7af0a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:10.010023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf5c9a-b73b-4959-9f21-e57331a7af0a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:10.041860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613e709-76e2-4e05-b5ed-d0fe9a223188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:10.042741 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e709-76e2-4e05-b5ed-d0fe9a223188 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:10.043018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e709-76e2-4e05-b5ed-d0fe9a223188 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:10.043285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e709-76e2-4e05-b5ed-d0fe9a223188 None admin] PATH_INFO: `/v3/users/4b768c2338334f4cb9de7fb944416449` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:10.044450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613e709-76e2-4e05-b5ed-d0fe9a223188 None admin] RBAC: Authorizing `identity:get_user(user_id=4b768c2338334f4cb9de7fb944416449)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:10.045868 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613e709-76e2-4e05-b5ed-d0fe9a223188 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:10.047512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 552/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:09 2022] GET /identity/v3/users/4b768c2338334f4cb9de7fb944416449 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:10.053302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc22c81-6ba2-48ae-bf0c-bb4b3640a6ea None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:10.147349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc22c81-6ba2-48ae-bf0c-bb4b3640a6ea None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:10.177994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ce8fb-355f-4053-9423-436235271b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:10.178854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce8fb-355f-4053-9423-436235271b64 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:10.179129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce8fb-355f-4053-9423-436235271b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:10.179397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce8fb-355f-4053-9423-436235271b64 None admin] PATH_INFO: `/v3/projects/29dbe183839c4ab6885e1d189d853e27` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:10.180548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ce8fb-355f-4053-9423-436235271b64 None admin] RBAC: Authorizing `identity:get_project(project_id=29dbe183839c4ab6885e1d189d853e27)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:10.181960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ce8fb-355f-4053-9423-436235271b64 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:10.183655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 570/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:10 2022] GET /identity/v3/projects/29dbe183839c4ab6885e1d189d853e27 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:10.190142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613e709-76e2-4e05-b5ed-d0fe9a223188 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:10.281734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613e709-76e2-4e05-b5ed-d0fe9a223188 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:10.313025 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09497f82-29ee-4b5e-b34d-85a2c19a64ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:10.313893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497f82-29ee-4b5e-b34d-85a2c19a64ab None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:10.314249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497f82-29ee-4b5e-b34d-85a2c19a64ab None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:10.315031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497f82-29ee-4b5e-b34d-85a2c19a64ab None admin] PATH_INFO: `/v3/projects/29dbe183839c4ab6885e1d189d853e27/users/4b768c2338334f4cb9de7fb944416449/roles/638115ca27864c64a0554c5c0913956a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:10.317194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09497f82-29ee-4b5e-b34d-85a2c19a64ab None admin] RBAC: Authorizing `identity:create_grant(project_id=29dbe183839c4ab6885e1d189d853e27, user_id=4b768c2338334f4cb9de7fb944416449, role_id=638115ca27864c64a0554c5c0913956a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:10.318648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09497f82-29ee-4b5e-b34d-85a2c19a64ab None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:10.409131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 553/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:57:10 2022] PUT /identity/v3/projects/29dbe183839c4ab6885e1d189d853e27/users/4b768c2338334f4cb9de7fb944416449/roles/638115ca27864c64a0554c5c0913956a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:57:12.565026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3241e6f-3ecd-4b3d-8720-12c821182cbf None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:12.565542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3241e6f-3ecd-4b3d-8720-12c821182cbf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:12.565634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3241e6f-3ecd-4b3d-8720-12c821182cbf None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:12.566990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 571/1124] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:12.572223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623065fc-8678-4715-b807-7e7f53f6da74 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:12.572612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623065fc-8678-4715-b807-7e7f53f6da74 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:12.572781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623065fc-8678-4715-b807-7e7f53f6da74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:12.589238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-623065fc-8678-4715-b807-7e7f53f6da74 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:12.590704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-623065fc-8678-4715-b807-7e7f53f6da74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:12.652132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 554/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:12.675454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3241e6f-3ecd-4b3d-8720-12c821182cbf None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:12.769075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3241e6f-3ecd-4b3d-8720-12c821182cbf None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:12.800522 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e116a3-f86c-4481-bd0d-273310c82175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:12.801354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e116a3-f86c-4481-bd0d-273310c82175 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:12.801632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e116a3-f86c-4481-bd0d-273310c82175 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:12.801904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e116a3-f86c-4481-bd0d-273310c82175 None admin] PATH_INFO: `/v3/roles/638115ca27864c64a0554c5c0913956a` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:12.803384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e116a3-f86c-4481-bd0d-273310c82175 None admin] RBAC: Authorizing `identity:get_role(role_id=638115ca27864c64a0554c5c0913956a)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:12.804735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e116a3-f86c-4481-bd0d-273310c82175 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:12.806094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 572/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:12 2022] GET /identity/v3/roles/638115ca27864c64a0554c5c0913956a => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:12.811589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623065fc-8678-4715-b807-7e7f53f6da74 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:12.903123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623065fc-8678-4715-b807-7e7f53f6da74 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:12.934525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab792657-fc4d-463d-a9a4-a1ebbac28a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:12.935355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab792657-fc4d-463d-a9a4-a1ebbac28a5e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:12.935632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab792657-fc4d-463d-a9a4-a1ebbac28a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:12.935898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab792657-fc4d-463d-a9a4-a1ebbac28a5e None admin] PATH_INFO: `/v3/users/4b768c2338334f4cb9de7fb944416449` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:12.937035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab792657-fc4d-463d-a9a4-a1ebbac28a5e None admin] RBAC: Authorizing `identity:get_user(user_id=4b768c2338334f4cb9de7fb944416449)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:12.938605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab792657-fc4d-463d-a9a4-a1ebbac28a5e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:12.940680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 555/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:12 2022] GET /identity/v3/users/4b768c2338334f4cb9de7fb944416449 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:12.946160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e116a3-f86c-4481-bd0d-273310c82175 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:13.036998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e116a3-f86c-4481-bd0d-273310c82175 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:13.068778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892cba1-b86b-4223-b7a3-2f256b911fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:13.069404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892cba1-b86b-4223-b7a3-2f256b911fae None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:13.069682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892cba1-b86b-4223-b7a3-2f256b911fae None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:13.069952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892cba1-b86b-4223-b7a3-2f256b911fae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:13.131725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892cba1-b86b-4223-b7a3-2f256b911fae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:13.133153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892cba1-b86b-4223-b7a3-2f256b911fae None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:13.222763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 573/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:57:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:57:13.228467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab792657-fc4d-463d-a9a4-a1ebbac28a5e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:13.320959 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab792657-fc4d-463d-a9a4-a1ebbac28a5e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:13.352755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061f5e-eaf3-4536-8ba4-c44285a18baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:13.353595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061f5e-eaf3-4536-8ba4-c44285a18baf None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:13.353869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061f5e-eaf3-4536-8ba4-c44285a18baf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:13.354228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061f5e-eaf3-4536-8ba4-c44285a18baf None admin] PATH_INFO: `/v3/projects/29dbe183839c4ab6885e1d189d853e27` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:13.355391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8061f5e-eaf3-4536-8ba4-c44285a18baf None admin] RBAC: Authorizing `identity:get_project(project_id=29dbe183839c4ab6885e1d189d853e27)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:13.356807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8061f5e-eaf3-4536-8ba4-c44285a18baf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:13.358492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 556/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:13 2022] GET /identity/v3/projects/29dbe183839c4ab6885e1d189d853e27 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:13.364949 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892cba1-b86b-4223-b7a3-2f256b911fae None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:13.455913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892cba1-b86b-4223-b7a3-2f256b911fae None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:13.487032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a10fa4-98e1-48fc-bd98-92b5673d9473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:13.487606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a10fa4-98e1-48fc-bd98-92b5673d9473 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:13.487878 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a10fa4-98e1-48fc-bd98-92b5673d9473 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:13.488146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a10fa4-98e1-48fc-bd98-92b5673d9473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:13.488947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a10fa4-98e1-48fc-bd98-92b5673d9473 None admin] RBAC: Adding query filter params (role.id=638115ca27864c64a0554c5c0913956a, scope.project.id=29dbe183839c4ab6885e1d189d853e27, user.id=4b768c2338334f4cb9de7fb944416449) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:13.489252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a10fa4-98e1-48fc-bd98-92b5673d9473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:13.490683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a10fa4-98e1-48fc-bd98-92b5673d9473 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:13.496080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 574/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:57:13 2022] GET /identity/v3/role_assignments?user.id=4b768c2338334f4cb9de7fb944416449&scope.project.id=29dbe183839c4ab6885e1d189d853e27&role.id=638115ca27864c64a0554c5c0913956a => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:15.683925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907336a-8fd5-44fe-9e68-346126844d08 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:15.684482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907336a-8fd5-44fe-9e68-346126844d08 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:15.684482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907336a-8fd5-44fe-9e68-346126844d08 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:15.685813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 557/1131] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:15.691695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2a881-2d12-4955-b288-f83a32b36abe None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:15.692105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2a881-2d12-4955-b288-f83a32b36abe None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:15.692280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2a881-2d12-4955-b288-f83a32b36abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:15.708276 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d5d2a881-2d12-4955-b288-f83a32b36abe None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:15.709443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d5d2a881-2d12-4955-b288-f83a32b36abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:15.771074 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 575/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:57:15.793781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907336a-8fd5-44fe-9e68-346126844d08 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:15.887519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907336a-8fd5-44fe-9e68-346126844d08 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:15.918717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b403f-75c9-4b4d-8422-131b232cfbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:15.919479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b403f-75c9-4b4d-8422-131b232cfbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:15.919753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b403f-75c9-4b4d-8422-131b232cfbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:15.920019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b403f-75c9-4b4d-8422-131b232cfbd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:15.921160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b403f-75c9-4b4d-8422-131b232cfbd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:15.922606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b403f-75c9-4b4d-8422-131b232cfbd7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:15.924714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 558/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:57:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:15.930345 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2a881-2d12-4955-b288-f83a32b36abe None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:16.021347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2a881-2d12-4955-b288-f83a32b36abe None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:16.053433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd890bd-c5ea-4d58-bffd-70ae53f0ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:16.054093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd890bd-c5ea-4d58-bffd-70ae53f0ca99 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:16.054378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd890bd-c5ea-4d58-bffd-70ae53f0ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:16.054649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd890bd-c5ea-4d58-bffd-70ae53f0ca99 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:16.055348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd890bd-c5ea-4d58-bffd-70ae53f0ca99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:16.056757 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd890bd-c5ea-4d58-bffd-70ae53f0ca99 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:16.189684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 576/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:57:15 2022] POST /identity/v3/projects => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:57:18.383628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bf11c-2615-4793-90b8-c6f5aa5bcfd4 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:18.384127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bf11c-2615-4793-90b8-c6f5aa5bcfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:18.384127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bf11c-2615-4793-90b8-c6f5aa5bcfd4 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:18.385471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 559/1135] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:18.390658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be3440-b1c2-4702-9eb6-6e86742cb569 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:18.391072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be3440-b1c2-4702-9eb6-6e86742cb569 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:18.391197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be3440-b1c2-4702-9eb6-6e86742cb569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:18.407918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c5be3440-b1c2-4702-9eb6-6e86742cb569 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:18.409085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c5be3440-b1c2-4702-9eb6-6e86742cb569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:18.470836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 577/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:18.494887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bf11c-2615-4793-90b8-c6f5aa5bcfd4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:18.590674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bf11c-2615-4793-90b8-c6f5aa5bcfd4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:18.621904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373113c1-d718-4700-98e7-0625f782aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:18.622706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373113c1-d718-4700-98e7-0625f782aacc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:18.622987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373113c1-d718-4700-98e7-0625f782aacc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:18.623258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373113c1-d718-4700-98e7-0625f782aacc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:18.624414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373113c1-d718-4700-98e7-0625f782aacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:18.625835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373113c1-d718-4700-98e7-0625f782aacc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:18.628043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 560/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:18.633846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be3440-b1c2-4702-9eb6-6e86742cb569 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:18.725291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be3440-b1c2-4702-9eb6-6e86742cb569 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:18.758931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d177e2-50f0-410d-b6b5-281ace291c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:18.759593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d177e2-50f0-410d-b6b5-281ace291c0e None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:18.759873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d177e2-50f0-410d-b6b5-281ace291c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:18.760146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d177e2-50f0-410d-b6b5-281ace291c0e None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:18.760860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d177e2-50f0-410d-b6b5-281ace291c0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:18.762318 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d177e2-50f0-410d-b6b5-281ace291c0e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:18.862896 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 578/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:57:18 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:57:21.071547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da39f9-3277-407b-abea-8c7fab112948 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:21.072099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da39f9-3277-407b-abea-8c7fab112948 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:21.072099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da39f9-3277-407b-abea-8c7fab112948 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:21.073442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 561/1139] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:21.078619 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d7521-60e8-4ac3-9c7e-442cc1e07779 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:21.079047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d7521-60e8-4ac3-9c7e-442cc1e07779 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:21.079155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d7521-60e8-4ac3-9c7e-442cc1e07779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:21.096582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a90d7521-60e8-4ac3-9c7e-442cc1e07779 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:21.097743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a90d7521-60e8-4ac3-9c7e-442cc1e07779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:21.158953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 579/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:21.181917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da39f9-3277-407b-abea-8c7fab112948 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:21.276218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da39f9-3277-407b-abea-8c7fab112948 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:21.307058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4a21b-479a-4510-b90f-312be96f4e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:21.307893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4a21b-479a-4510-b90f-312be96f4e34 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:21.308170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4a21b-479a-4510-b90f-312be96f4e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:21.308440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4a21b-479a-4510-b90f-312be96f4e34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:21.318453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4a21b-479a-4510-b90f-312be96f4e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-45d4a21b-479a-4510-b90f-312be96f4e34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:57:21.328680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:21.329769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:21.331242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 562/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:21.333785 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d7521-60e8-4ac3-9c7e-442cc1e07779 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:21.424332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d7521-60e8-4ac3-9c7e-442cc1e07779 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:21.456031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082f34-b603-4b8f-9713-99a2055df60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:21.456676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082f34-b603-4b8f-9713-99a2055df60a None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:21.456953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082f34-b603-4b8f-9713-99a2055df60a None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:21.457223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082f34-b603-4b8f-9713-99a2055df60a None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:21.457956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082f34-b603-4b8f-9713-99a2055df60a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:21.458287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082f34-b603-4b8f-9713-99a2055df60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:21.459649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082f34-b603-4b8f-9713-99a2055df60a None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:21.467480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 580/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:57:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:21.473283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4a21b-479a-4510-b90f-312be96f4e34 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:21.566707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4a21b-479a-4510-b90f-312be96f4e34 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:21.597915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f95b00-8ada-4947-8c8f-49745a90c5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:21.598747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f95b00-8ada-4947-8c8f-49745a90c5cb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:21.599055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f95b00-8ada-4947-8c8f-49745a90c5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:21.599329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f95b00-8ada-4947-8c8f-49745a90c5cb None admin] PATH_INFO: `/v3/users/77ef6738a7484803842827b29f2f2431` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:21.612120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f95b00-8ada-4947-8c8f-49745a90c5cb None admin] RBAC: Authorizing `identity:get_user(user_id=77ef6738a7484803842827b29f2f2431)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:21.613553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f95b00-8ada-4947-8c8f-49745a90c5cb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:21.615200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 563/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:21 2022] GET /identity/v3/users/77ef6738a7484803842827b29f2f2431 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:21.620951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082f34-b603-4b8f-9713-99a2055df60a None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:21.714076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082f34-b603-4b8f-9713-99a2055df60a None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:21.745768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74dc77-b72d-4198-9a45-ed01230ec30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:21.746445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74dc77-b72d-4198-9a45-ed01230ec30b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:21.746727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74dc77-b72d-4198-9a45-ed01230ec30b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:21.747005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74dc77-b72d-4198-9a45-ed01230ec30b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:21.808562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74dc77-b72d-4198-9a45-ed01230ec30b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:21.809993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74dc77-b72d-4198-9a45-ed01230ec30b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:21.899793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 581/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:57:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:57:21.905568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f95b00-8ada-4947-8c8f-49745a90c5cb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:21.999608 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f95b00-8ada-4947-8c8f-49745a90c5cb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:22.030557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3567a-becb-4a23-80a9-5daf179f53fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:22.031392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3567a-becb-4a23-80a9-5daf179f53fb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:22.031666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3567a-becb-4a23-80a9-5daf179f53fb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:22.031932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3567a-becb-4a23-80a9-5daf179f53fb None admin] PATH_INFO: `/v3/projects/571a5dced4a04e99bf0c7b088603208f` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:22.033581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3567a-becb-4a23-80a9-5daf179f53fb None admin] RBAC: Authorizing `identity:get_project(project_id=571a5dced4a04e99bf0c7b088603208f)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:22.035035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3567a-becb-4a23-80a9-5daf179f53fb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:22.036718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 564/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:21 2022] GET /identity/v3/projects/571a5dced4a04e99bf0c7b088603208f => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:22.042602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74dc77-b72d-4198-9a45-ed01230ec30b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:22.133541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74dc77-b72d-4198-9a45-ed01230ec30b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:22.165435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc3d86-28f4-48bc-a5b1-72db9779e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:22.166012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3d86-28f4-48bc-a5b1-72db9779e38c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:22.166321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3d86-28f4-48bc-a5b1-72db9779e38c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:22.166593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc3d86-28f4-48bc-a5b1-72db9779e38c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:22.167403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3d86-28f4-48bc-a5b1-72db9779e38c None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=571a5dced4a04e99bf0c7b088603208f, user.id=77ef6738a7484803842827b29f2f2431) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:22.167711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3d86-28f4-48bc-a5b1-72db9779e38c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:22.169116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc3d86-28f4-48bc-a5b1-72db9779e38c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:22.174846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 582/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:57:22 2022] GET /identity/v3/role_assignments?user.id=77ef6738a7484803842827b29f2f2431&scope.project.id=571a5dced4a04e99bf0c7b088603208f&role.id=042169a166e14a80beac826291ceaf73 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:24.326162 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c877ae-a978-4e4f-b59c-caf8c78f2e4e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:24.326691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c877ae-a978-4e4f-b59c-caf8c78f2e4e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:24.326691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c877ae-a978-4e4f-b59c-caf8c78f2e4e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:24.328052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 565/1147] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:24.333871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd0d02-f8e5-4ae9-b4ee-24473f769d6b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:24.334390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd0d02-f8e5-4ae9-b4ee-24473f769d6b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:24.334390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd0d02-f8e5-4ae9-b4ee-24473f769d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:24.350607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-42bd0d02-f8e5-4ae9-b4ee-24473f769d6b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:24.351757 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-42bd0d02-f8e5-4ae9-b4ee-24473f769d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:24.412469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 583/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:24.433831 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c877ae-a978-4e4f-b59c-caf8c78f2e4e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:24.528773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c877ae-a978-4e4f-b59c-caf8c78f2e4e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:24.560169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d90ade-86e8-4f8d-808c-505fb85032a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:24.560927 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90ade-86e8-4f8d-808c-505fb85032a2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:24.561203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90ade-86e8-4f8d-808c-505fb85032a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:24.561471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90ade-86e8-4f8d-808c-505fb85032a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:24.571416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d90ade-86e8-4f8d-808c-505fb85032a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-72d90ade-86e8-4f8d-808c-505fb85032a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:57:24.578915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:24.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:24.581100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 566/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:57:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:24.586085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd0d02-f8e5-4ae9-b4ee-24473f769d6b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:24.675621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd0d02-f8e5-4ae9-b4ee-24473f769d6b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:24.706653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4db6de-0fa0-404f-b566-7fd1edc8475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:24.707297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4db6de-0fa0-404f-b566-7fd1edc8475d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:24.707573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4db6de-0fa0-404f-b566-7fd1edc8475d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:24.707839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4db6de-0fa0-404f-b566-7fd1edc8475d None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:24.708566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4db6de-0fa0-404f-b566-7fd1edc8475d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:24.708864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4db6de-0fa0-404f-b566-7fd1edc8475d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:24.710248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4db6de-0fa0-404f-b566-7fd1edc8475d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:24.717951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 584/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:57:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:24.723758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d90ade-86e8-4f8d-808c-505fb85032a2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:24.821575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d90ade-86e8-4f8d-808c-505fb85032a2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:24.852431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80a0d5-86d0-4d2b-98fb-c876041305fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:24.853212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80a0d5-86d0-4d2b-98fb-c876041305fe None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:24.853487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80a0d5-86d0-4d2b-98fb-c876041305fe None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:24.853752 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80a0d5-86d0-4d2b-98fb-c876041305fe None admin] PATH_INFO: `/v3/users/77ef6738a7484803842827b29f2f2431` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:24.854929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80a0d5-86d0-4d2b-98fb-c876041305fe None admin] RBAC: Authorizing `identity:get_user(user_id=77ef6738a7484803842827b29f2f2431)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:24.856351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80a0d5-86d0-4d2b-98fb-c876041305fe None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:24.857938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 567/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:24 2022] GET /identity/v3/users/77ef6738a7484803842827b29f2f2431 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:24.864091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4db6de-0fa0-404f-b566-7fd1edc8475d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:24.955712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4db6de-0fa0-404f-b566-7fd1edc8475d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:24.987155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7baaea-f03e-4592-8547-0712d191b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:24.987988 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7baaea-f03e-4592-8547-0712d191b998 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:24.988262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7baaea-f03e-4592-8547-0712d191b998 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:24.988528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7baaea-f03e-4592-8547-0712d191b998 None admin] PATH_INFO: `/v3/projects/571a5dced4a04e99bf0c7b088603208f` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:24.989696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7baaea-f03e-4592-8547-0712d191b998 None admin] RBAC: Authorizing `identity:get_project(project_id=571a5dced4a04e99bf0c7b088603208f)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:24.991143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7baaea-f03e-4592-8547-0712d191b998 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:24.992800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 585/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:24 2022] GET /identity/v3/projects/571a5dced4a04e99bf0c7b088603208f => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:24.998399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80a0d5-86d0-4d2b-98fb-c876041305fe None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:25.091668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80a0d5-86d0-4d2b-98fb-c876041305fe None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:25.123430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d306f-7aa6-47b6-adf5-74293903516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:25.124234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d306f-7aa6-47b6-adf5-74293903516d None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:25.124512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d306f-7aa6-47b6-adf5-74293903516d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:25.124785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d306f-7aa6-47b6-adf5-74293903516d None admin] PATH_INFO: `/v3/projects/571a5dced4a04e99bf0c7b088603208f/users/77ef6738a7484803842827b29f2f2431/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:25.126722 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d306f-7aa6-47b6-adf5-74293903516d None admin] RBAC: Authorizing `identity:create_grant(project_id=571a5dced4a04e99bf0c7b088603208f, user_id=77ef6738a7484803842827b29f2f2431, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:25.128175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d306f-7aa6-47b6-adf5-74293903516d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:25.227470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 568/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:57:24 2022] PUT /identity/v3/projects/571a5dced4a04e99bf0c7b088603208f/users/77ef6738a7484803842827b29f2f2431/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 14:57:27.405503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751faf7-6968-4d8a-9db0-e8dc14d7e91b None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:27.406081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751faf7-6968-4d8a-9db0-e8dc14d7e91b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:27.406081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751faf7-6968-4d8a-9db0-e8dc14d7e91b None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:27.407364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 586/1154] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:27.412599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f2fd2-80a4-42d7-bcc9-30d0f42dff79 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:27.413053 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f2fd2-80a4-42d7-bcc9-30d0f42dff79 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:27.413154 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f2fd2-80a4-42d7-bcc9-30d0f42dff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:27.429318 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e50f2fd2-80a4-42d7-bcc9-30d0f42dff79 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:27.430509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e50f2fd2-80a4-42d7-bcc9-30d0f42dff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:27.492922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 569/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:27.516117 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751faf7-6968-4d8a-9db0-e8dc14d7e91b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:27.610552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751faf7-6968-4d8a-9db0-e8dc14d7e91b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:27.642289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820935f-0f9a-48d2-a12b-6d9992b79a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:27.643055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820935f-0f9a-48d2-a12b-6d9992b79a4e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:27.643333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820935f-0f9a-48d2-a12b-6d9992b79a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:27.643603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820935f-0f9a-48d2-a12b-6d9992b79a4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:27.653460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820935f-0f9a-48d2-a12b-6d9992b79a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-a820935f-0f9a-48d2-a12b-6d9992b79a4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:57:27.660884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:27.662084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:57:27.663328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 587/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:57:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:27.667736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f2fd2-80a4-42d7-bcc9-30d0f42dff79 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:27.759904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f2fd2-80a4-42d7-bcc9-30d0f42dff79 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:27.790774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c4057-7e02-4c3e-8c89-6d6a60bbfa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:27.791417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c4057-7e02-4c3e-8c89-6d6a60bbfa9b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:27.791694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c4057-7e02-4c3e-8c89-6d6a60bbfa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:27.791966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c4057-7e02-4c3e-8c89-6d6a60bbfa9b None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:27.792693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c4057-7e02-4c3e-8c89-6d6a60bbfa9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:27.792994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c4057-7e02-4c3e-8c89-6d6a60bbfa9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:27.794375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c4057-7e02-4c3e-8c89-6d6a60bbfa9b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:27.802399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 570/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:27.808055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820935f-0f9a-48d2-a12b-6d9992b79a4e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:27.899365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820935f-0f9a-48d2-a12b-6d9992b79a4e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:27.930417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b728146-3749-478f-9d5b-d6104b2424d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:27.931204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b728146-3749-478f-9d5b-d6104b2424d9 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:27.931481 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b728146-3749-478f-9d5b-d6104b2424d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:27.931748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b728146-3749-478f-9d5b-d6104b2424d9 None admin] PATH_INFO: `/v3/users/77ef6738a7484803842827b29f2f2431` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:27.932902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b728146-3749-478f-9d5b-d6104b2424d9 None admin] RBAC: Authorizing `identity:get_user(user_id=77ef6738a7484803842827b29f2f2431)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:27.934333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b728146-3749-478f-9d5b-d6104b2424d9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:27.935923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 588/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:27 2022] GET /identity/v3/users/77ef6738a7484803842827b29f2f2431 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:27.942599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c4057-7e02-4c3e-8c89-6d6a60bbfa9b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:28.036141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c4057-7e02-4c3e-8c89-6d6a60bbfa9b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:28.067188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25836f9-e307-4815-95f6-f4fd65cb64f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:28.067826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25836f9-e307-4815-95f6-f4fd65cb64f0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:28.068107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25836f9-e307-4815-95f6-f4fd65cb64f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:28.068378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25836f9-e307-4815-95f6-f4fd65cb64f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:28.131587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25836f9-e307-4815-95f6-f4fd65cb64f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:28.133026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25836f9-e307-4815-95f6-f4fd65cb64f0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:28.223332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 571/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:57:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:57:28.229313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b728146-3749-478f-9d5b-d6104b2424d9 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:28.320866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b728146-3749-478f-9d5b-d6104b2424d9 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:28.352460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d8e97-978f-4ca5-bcc2-099fe490dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:28.353280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d8e97-978f-4ca5-bcc2-099fe490dcea None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:28.353554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d8e97-978f-4ca5-bcc2-099fe490dcea None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:28.353819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d8e97-978f-4ca5-bcc2-099fe490dcea None admin] PATH_INFO: `/v3/projects/571a5dced4a04e99bf0c7b088603208f` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:28.355002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d8e97-978f-4ca5-bcc2-099fe490dcea None admin] RBAC: Authorizing `identity:get_project(project_id=571a5dced4a04e99bf0c7b088603208f)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:28.356407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d8e97-978f-4ca5-bcc2-099fe490dcea None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:28.358049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 589/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:28 2022] GET /identity/v3/projects/571a5dced4a04e99bf0c7b088603208f => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:28.364173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25836f9-e307-4815-95f6-f4fd65cb64f0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:28.455756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25836f9-e307-4815-95f6-f4fd65cb64f0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:28.487582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f80733-3c92-4e7a-b502-4bd3a03b5b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:28.488160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80733-3c92-4e7a-b502-4bd3a03b5b2c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:28.488440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80733-3c92-4e7a-b502-4bd3a03b5b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:28.488711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f80733-3c92-4e7a-b502-4bd3a03b5b2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:28.489522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f80733-3c92-4e7a-b502-4bd3a03b5b2c None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=571a5dced4a04e99bf0c7b088603208f, user.id=77ef6738a7484803842827b29f2f2431) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:28.489829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f80733-3c92-4e7a-b502-4bd3a03b5b2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:28.491272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f80733-3c92-4e7a-b502-4bd3a03b5b2c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:28.496775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 572/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:57:28 2022] GET /identity/v3/role_assignments?user.id=77ef6738a7484803842827b29f2f2431&scope.project.id=571a5dced4a04e99bf0c7b088603208f&role.id=042169a166e14a80beac826291ceaf73 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:57:30.705984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655608af-f0d0-46a7-ad5a-b9d9654704c7 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:30.706555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655608af-f0d0-46a7-ad5a-b9d9654704c7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:30.706730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655608af-f0d0-46a7-ad5a-b9d9654704c7 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:30.708114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 590/1162] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:30.713348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c72369-41cc-4336-920b-723400634b87 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:30.713748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c72369-41cc-4336-920b-723400634b87 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:30.713901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c72369-41cc-4336-920b-723400634b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:30.730843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-96c72369-41cc-4336-920b-723400634b87 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:30.732011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-96c72369-41cc-4336-920b-723400634b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:30.793833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 573/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:30.815201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655608af-f0d0-46a7-ad5a-b9d9654704c7 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:30.910190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655608af-f0d0-46a7-ad5a-b9d9654704c7 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:30.942071 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d279d-bfbb-4437-bdea-a9f7b0f34040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:30.942715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d279d-bfbb-4437-bdea-a9f7b0f34040 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:30.942997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d279d-bfbb-4437-bdea-a9f7b0f34040 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:30.943272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d279d-bfbb-4437-bdea-a9f7b0f34040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:31.005857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d279d-bfbb-4437-bdea-a9f7b0f34040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:31.007263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d279d-bfbb-4437-bdea-a9f7b0f34040 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:31.101850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 591/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:57:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:57:31.108012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c72369-41cc-4336-920b-723400634b87 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:31.199474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c72369-41cc-4336-920b-723400634b87 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:31.231257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf564d6-ad4f-499b-b32d-2959e0b3bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:31.232032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf564d6-ad4f-499b-b32d-2959e0b3bc96 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:31.232312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf564d6-ad4f-499b-b32d-2959e0b3bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:31.232582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf564d6-ad4f-499b-b32d-2959e0b3bc96 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:31.238942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf564d6-ad4f-499b-b32d-2959e0b3bc96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:31.240365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf564d6-ad4f-499b-b32d-2959e0b3bc96 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ccf564d6-ad4f-499b-b32d-2959e0b3bc96 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:31.254827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:31.256077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:31.256970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 574/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:57:31 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:31.261781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d279d-bfbb-4437-bdea-a9f7b0f34040 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:31.353196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d279d-bfbb-4437-bdea-a9f7b0f34040 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:31.385553 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe97a8-04db-42d9-bbd6-1dd43d4cfe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:31.386224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe97a8-04db-42d9-bbd6-1dd43d4cfe48 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:31.386506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe97a8-04db-42d9-bbd6-1dd43d4cfe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:31.386777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe97a8-04db-42d9-bbd6-1dd43d4cfe48 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:31.387526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe97a8-04db-42d9-bbd6-1dd43d4cfe48 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:31.387830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe97a8-04db-42d9-bbd6-1dd43d4cfe48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:31.389180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe97a8-04db-42d9-bbd6-1dd43d4cfe48 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:31.396445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 592/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Mon May 16 14:57:31 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:33.589362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3b605-a862-4e74-b08b-4d8ca6613009 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:33.589943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3b605-a862-4e74-b08b-4d8ca6613009 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:33.589943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3b605-a862-4e74-b08b-4d8ca6613009 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:33.591311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 575/1167] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:33.597494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bece836-8422-4cbf-b878-27ae43e2a909 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:33.597931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bece836-8422-4cbf-b878-27ae43e2a909 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:33.598065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bece836-8422-4cbf-b878-27ae43e2a909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:33.614212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3bece836-8422-4cbf-b878-27ae43e2a909 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:33.615381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3bece836-8422-4cbf-b878-27ae43e2a909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:33.677250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 593/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:33.699344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3b605-a862-4e74-b08b-4d8ca6613009 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:33.795029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3b605-a862-4e74-b08b-4d8ca6613009 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:33.825424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354364b-82f0-44aa-bb35-fb698f9b87b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:33.826084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354364b-82f0-44aa-bb35-fb698f9b87b4 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:33.826372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354364b-82f0-44aa-bb35-fb698f9b87b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:33.826645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354364b-82f0-44aa-bb35-fb698f9b87b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:33.827369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354364b-82f0-44aa-bb35-fb698f9b87b4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:33.828731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354364b-82f0-44aa-bb35-fb698f9b87b4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:33.904268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 576/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Mon May 16 14:57:33 2022] POST /identity/v3/domains => generated 267 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:57:36.143406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d49bd-d97b-47f9-a53d-9c90c6bb2a5f None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:36.143858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d49bd-d97b-47f9-a53d-9c90c6bb2a5f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:36.143965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d49bd-d97b-47f9-a53d-9c90c6bb2a5f None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:36.145328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 594/1170] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:36.150582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813dad-2690-4616-b787-43b3afb540d5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:36.151001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813dad-2690-4616-b787-43b3afb540d5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:36.151136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813dad-2690-4616-b787-43b3afb540d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:36.167891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fd813dad-2690-4616-b787-43b3afb540d5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:36.169043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fd813dad-2690-4616-b787-43b3afb540d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:36.232429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 577/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:57:36.262708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d49bd-d97b-47f9-a53d-9c90c6bb2a5f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:36.356406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d49bd-d97b-47f9-a53d-9c90c6bb2a5f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:36.387860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e749d-be8b-4aed-b5c4-4472a4d010e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:36.388689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e749d-be8b-4aed-b5c4-4472a4d010e7 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:36.388966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e749d-be8b-4aed-b5c4-4472a4d010e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:36.389259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e749d-be8b-4aed-b5c4-4472a4d010e7 None admin] PATH_INFO: `/v3/domains/2c5b8c13dae145d1a01c772e8281dc38` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:36.399438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e749d-be8b-4aed-b5c4-4472a4d010e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2c5b8c13dae145d1a01c772e8281dc38)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:36.400861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e749d-be8b-4aed-b5c4-4472a4d010e7 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:36.402483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 595/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Mon May 16 14:57:36 2022] GET /identity/v3/domains/2c5b8c13dae145d1a01c772e8281dc38 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:36.408273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd813dad-2690-4616-b787-43b3afb540d5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:36.498040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd813dad-2690-4616-b787-43b3afb540d5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:36.530005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976604d-810d-4360-8211-2f97c63b2947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:36.530679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976604d-810d-4360-8211-2f97c63b2947 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:36.530960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976604d-810d-4360-8211-2f97c63b2947 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:36.531234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976604d-810d-4360-8211-2f97c63b2947 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:36.531938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976604d-810d-4360-8211-2f97c63b2947 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:36.533888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976604d-810d-4360-8211-2f97c63b2947 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:36.623537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 578/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:57:36 2022] POST /identity/v3/projects => generated 361 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:57:38.839347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57662dbb-6fc0-4cea-8c67-9c944ebca372 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:38.839875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57662dbb-6fc0-4cea-8c67-9c944ebca372 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:38.839875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57662dbb-6fc0-4cea-8c67-9c944ebca372 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:38.841250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 596/1174] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:38.846755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eebcfb-8914-4c81-92fa-2c80c6ac4706 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:38.847146 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eebcfb-8914-4c81-92fa-2c80c6ac4706 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:38.847314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eebcfb-8914-4c81-92fa-2c80c6ac4706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:38.864065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-91eebcfb-8914-4c81-92fa-2c80c6ac4706 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:38.865264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-91eebcfb-8914-4c81-92fa-2c80c6ac4706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:38.927949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 579/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:38.952688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57662dbb-6fc0-4cea-8c67-9c944ebca372 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:39.047396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57662dbb-6fc0-4cea-8c67-9c944ebca372 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:39.079396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92d751-d5d6-4921-9a57-6e312538b290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:39.080275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92d751-d5d6-4921-9a57-6e312538b290 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:39.080549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92d751-d5d6-4921-9a57-6e312538b290 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:39.080817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92d751-d5d6-4921-9a57-6e312538b290 None admin] PATH_INFO: `/v3/domains/2c5b8c13dae145d1a01c772e8281dc38` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:39.081988 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92d751-d5d6-4921-9a57-6e312538b290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2c5b8c13dae145d1a01c772e8281dc38)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:39.083441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92d751-d5d6-4921-9a57-6e312538b290 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:39.085052 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 597/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Mon May 16 14:57:38 2022] GET /identity/v3/domains/2c5b8c13dae145d1a01c772e8281dc38 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:39.090768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eebcfb-8914-4c81-92fa-2c80c6ac4706 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:39.183745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eebcfb-8914-4c81-92fa-2c80c6ac4706 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:39.215646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88d72-953e-436b-b0db-6923f339c4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:39.216294 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88d72-953e-436b-b0db-6923f339c4e3 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:39.216574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88d72-953e-436b-b0db-6923f339c4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:39.217100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88d72-953e-436b-b0db-6923f339c4e3 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:39.217795 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88d72-953e-436b-b0db-6923f339c4e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:39.219235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88d72-953e-436b-b0db-6923f339c4e3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:39.377465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 580/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:57:39 2022] POST /identity/v3/users => generated 311 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 14:57:41.626237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d4f2-4ac9-46d8-be21-0b1baa35eaea None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:41.626772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d4f2-4ac9-46d8-be21-0b1baa35eaea None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:41.626772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9d4f2-4ac9-46d8-be21-0b1baa35eaea None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:41.628647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 598/1178] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:41.633746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f21b-1a70-480a-8c99-174fd3b1fb98 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:41.634204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f21b-1a70-480a-8c99-174fd3b1fb98 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:41.634353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823f21b-1a70-480a-8c99-174fd3b1fb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:41.650968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6823f21b-1a70-480a-8c99-174fd3b1fb98 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:41.652119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6823f21b-1a70-480a-8c99-174fd3b1fb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:41.713088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 581/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:41.736009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9d4f2-4ac9-46d8-be21-0b1baa35eaea None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:41.830495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9d4f2-4ac9-46d8-be21-0b1baa35eaea None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:41.861069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d8c79-17dd-4973-b839-5e1b35d18a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:41.861833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d8c79-17dd-4973-b839-5e1b35d18a38 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:41.862146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d8c79-17dd-4973-b839-5e1b35d18a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:41.862422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d8c79-17dd-4973-b839-5e1b35d18a38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:41.872796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d8c79-17dd-4973-b839-5e1b35d18a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-872d8c79-17dd-4973-b839-5e1b35d18a38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:57:41.880839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:41.881956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:57:41.883009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 599/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:57:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:41.887676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823f21b-1a70-480a-8c99-174fd3b1fb98 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:41.978514 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823f21b-1a70-480a-8c99-174fd3b1fb98 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:42.010302 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed035346-f4d7-464f-b77c-67238c22a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:42.010952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed035346-f4d7-464f-b77c-67238c22a546 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:42.011226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed035346-f4d7-464f-b77c-67238c22a546 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:42.011491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed035346-f4d7-464f-b77c-67238c22a546 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:42.012219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed035346-f4d7-464f-b77c-67238c22a546 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:42.012517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed035346-f4d7-464f-b77c-67238c22a546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:42.013877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed035346-f4d7-464f-b77c-67238c22a546 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:42.021526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 582/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:57:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:57:42.027055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d8c79-17dd-4973-b839-5e1b35d18a38 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:42.121064 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d8c79-17dd-4973-b839-5e1b35d18a38 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:42.152599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454751-2a4e-456b-93c8-b5b6c6679e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:42.153390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454751-2a4e-456b-93c8-b5b6c6679e48 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:42.153670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454751-2a4e-456b-93c8-b5b6c6679e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:42.153943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454751-2a4e-456b-93c8-b5b6c6679e48 None admin] PATH_INFO: `/v3/users/90ff984e0b6648599d07e52292f11bd4` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:42.166573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46454751-2a4e-456b-93c8-b5b6c6679e48 None admin] RBAC: Authorizing `identity:get_user(user_id=90ff984e0b6648599d07e52292f11bd4)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:42.168005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46454751-2a4e-456b-93c8-b5b6c6679e48 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:42.169632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 600/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:42 2022] GET /identity/v3/users/90ff984e0b6648599d07e52292f11bd4 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:57:42.175974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed035346-f4d7-464f-b77c-67238c22a546 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:42.268135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed035346-f4d7-464f-b77c-67238c22a546 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:42.299119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe54131-0732-4207-a4ef-21ffbbe9e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:42.299757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe54131-0732-4207-a4ef-21ffbbe9e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:42.300619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe54131-0732-4207-a4ef-21ffbbe9e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:42.300909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe54131-0732-4207-a4ef-21ffbbe9e9d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:42.363711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe54131-0732-4207-a4ef-21ffbbe9e9d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:42.365251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe54131-0732-4207-a4ef-21ffbbe9e9d0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:42.457512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 583/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:57:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:57:42.463505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454751-2a4e-456b-93c8-b5b6c6679e48 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:42.554895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454751-2a4e-456b-93c8-b5b6c6679e48 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:42.585849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f947ec-9f36-4b8f-9ec3-0e2e9e613258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:42.586820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f947ec-9f36-4b8f-9ec3-0e2e9e613258 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:42.587097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f947ec-9f36-4b8f-9ec3-0e2e9e613258 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:42.587364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f947ec-9f36-4b8f-9ec3-0e2e9e613258 None admin] PATH_INFO: `/v3/projects/81bb6b783dc24eac926722370b12fb85` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:42.588516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f947ec-9f36-4b8f-9ec3-0e2e9e613258 None admin] RBAC: Authorizing `identity:get_project(project_id=81bb6b783dc24eac926722370b12fb85)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:42.589919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f947ec-9f36-4b8f-9ec3-0e2e9e613258 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:42.591602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 601/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:42 2022] GET /identity/v3/projects/81bb6b783dc24eac926722370b12fb85 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:42.597788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe54131-0732-4207-a4ef-21ffbbe9e9d0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:42.689696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe54131-0732-4207-a4ef-21ffbbe9e9d0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:42.722585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2fe92-f89a-4cb7-aab2-4db040fde361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:42.723226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2fe92-f89a-4cb7-aab2-4db040fde361 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:42.723507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2fe92-f89a-4cb7-aab2-4db040fde361 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:42.723780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2fe92-f89a-4cb7-aab2-4db040fde361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:42.724588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2fe92-f89a-4cb7-aab2-4db040fde361 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=81bb6b783dc24eac926722370b12fb85, user.id=90ff984e0b6648599d07e52292f11bd4) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:42.724896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2fe92-f89a-4cb7-aab2-4db040fde361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:42.726347 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2fe92-f89a-4cb7-aab2-4db040fde361 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:42.731469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 584/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:57:42 2022] GET /identity/v3/role_assignments?user.id=90ff984e0b6648599d07e52292f11bd4&scope.project.id=81bb6b783dc24eac926722370b12fb85&role.id=042169a166e14a80beac826291ceaf73 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:44.886072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29757ae-cec5-499e-bcf6-90459cb4b455 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:44.886656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29757ae-cec5-499e-bcf6-90459cb4b455 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:44.886656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29757ae-cec5-499e-bcf6-90459cb4b455 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:44.887980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 602/1186] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:44.893143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abeadd2-41be-4a21-91b2-bbcd7633aaf9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:44.893537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abeadd2-41be-4a21-91b2-bbcd7633aaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:44.893692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abeadd2-41be-4a21-91b2-bbcd7633aaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:44.909791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7abeadd2-41be-4a21-91b2-bbcd7633aaf9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:44.910977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7abeadd2-41be-4a21-91b2-bbcd7633aaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:44.972666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 585/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:44.995166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29757ae-cec5-499e-bcf6-90459cb4b455 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:45.089213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29757ae-cec5-499e-bcf6-90459cb4b455 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:45.122420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8b42-0bdf-4f10-b5c2-754d980678e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:45.123190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8b42-0bdf-4f10-b5c2-754d980678e5 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:45.123470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8b42-0bdf-4f10-b5c2-754d980678e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:45.123741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8b42-0bdf-4f10-b5c2-754d980678e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:45.133776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f8b42-0bdf-4f10-b5c2-754d980678e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-da3f8b42-0bdf-4f10-b5c2-754d980678e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:57:45.141316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:45.142486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:57:45.143767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 603/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:57:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:45.148481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abeadd2-41be-4a21-91b2-bbcd7633aaf9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:45.241059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abeadd2-41be-4a21-91b2-bbcd7633aaf9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:45.272120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcd5a3-d035-47d5-b11b-7caa1b03c9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:45.272767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcd5a3-d035-47d5-b11b-7caa1b03c9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:45.273046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcd5a3-d035-47d5-b11b-7caa1b03c9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:45.273346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcd5a3-d035-47d5-b11b-7caa1b03c9e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:45.274088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcd5a3-d035-47d5-b11b-7caa1b03c9e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:45.274399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcd5a3-d035-47d5-b11b-7caa1b03c9e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:45.275758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcd5a3-d035-47d5-b11b-7caa1b03c9e4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:45.283343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 586/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:57:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:45.289600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8b42-0bdf-4f10-b5c2-754d980678e5 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:45.381842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8b42-0bdf-4f10-b5c2-754d980678e5 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:45.412656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadd10-bde8-4d6d-8bcd-8db90e19aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:45.413438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadd10-bde8-4d6d-8bcd-8db90e19aef0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:45.413712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadd10-bde8-4d6d-8bcd-8db90e19aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:45.413978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadd10-bde8-4d6d-8bcd-8db90e19aef0 None admin] PATH_INFO: `/v3/users/90ff984e0b6648599d07e52292f11bd4` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:45.415156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbadd10-bde8-4d6d-8bcd-8db90e19aef0 None admin] RBAC: Authorizing `identity:get_user(user_id=90ff984e0b6648599d07e52292f11bd4)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:45.416572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbadd10-bde8-4d6d-8bcd-8db90e19aef0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:45.418249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 604/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:45 2022] GET /identity/v3/users/90ff984e0b6648599d07e52292f11bd4 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:45.423760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcd5a3-d035-47d5-b11b-7caa1b03c9e4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:45.516681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcd5a3-d035-47d5-b11b-7caa1b03c9e4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:45.548525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da29e3-9a1e-40c6-83a4-79a01976d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:45.549359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da29e3-9a1e-40c6-83a4-79a01976d886 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:45.549638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da29e3-9a1e-40c6-83a4-79a01976d886 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:45.549908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da29e3-9a1e-40c6-83a4-79a01976d886 None admin] PATH_INFO: `/v3/projects/81bb6b783dc24eac926722370b12fb85` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:45.551098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da29e3-9a1e-40c6-83a4-79a01976d886 None admin] RBAC: Authorizing `identity:get_project(project_id=81bb6b783dc24eac926722370b12fb85)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:45.552521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da29e3-9a1e-40c6-83a4-79a01976d886 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:45.554190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 587/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:45 2022] GET /identity/v3/projects/81bb6b783dc24eac926722370b12fb85 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:45.559746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadd10-bde8-4d6d-8bcd-8db90e19aef0 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:45.651776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadd10-bde8-4d6d-8bcd-8db90e19aef0 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:45.682713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40c9f-bba5-4004-8f7e-74e8fb9a93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:45.683516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40c9f-bba5-4004-8f7e-74e8fb9a93a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:45.683793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40c9f-bba5-4004-8f7e-74e8fb9a93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:45.684063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40c9f-bba5-4004-8f7e-74e8fb9a93a9 None admin] PATH_INFO: `/v3/projects/81bb6b783dc24eac926722370b12fb85/users/90ff984e0b6648599d07e52292f11bd4/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:45.685978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40c9f-bba5-4004-8f7e-74e8fb9a93a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=81bb6b783dc24eac926722370b12fb85, user_id=90ff984e0b6648599d07e52292f11bd4, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:45.687417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40c9f-bba5-4004-8f7e-74e8fb9a93a9 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:45.754469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 605/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:57:45 2022] PUT /identity/v3/projects/81bb6b783dc24eac926722370b12fb85/users/90ff984e0b6648599d07e52292f11bd4/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:57:47.915247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924e94e-63df-48bb-a0ac-ecd49e66a2ee None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:47.915800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924e94e-63df-48bb-a0ac-ecd49e66a2ee None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:47.915800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924e94e-63df-48bb-a0ac-ecd49e66a2ee None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:47.917137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 588/1193] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:57:47.922322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85700b1-471a-443f-8632-69fa77ec6bb1 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:47.922706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85700b1-471a-443f-8632-69fa77ec6bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:47.922877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85700b1-471a-443f-8632-69fa77ec6bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:47.939464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a85700b1-471a-443f-8632-69fa77ec6bb1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:57:47.940632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a85700b1-471a-443f-8632-69fa77ec6bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:57:48.002240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 606/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:57:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:57:48.025671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924e94e-63df-48bb-a0ac-ecd49e66a2ee None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:48.122372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924e94e-63df-48bb-a0ac-ecd49e66a2ee None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:48.152778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745db3a-1dcc-4c0e-86a7-cf7c612e1bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:48.153543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745db3a-1dcc-4c0e-86a7-cf7c612e1bfa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:48.153820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745db3a-1dcc-4c0e-86a7-cf7c612e1bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:48.154111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745db3a-1dcc-4c0e-86a7-cf7c612e1bfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:48.164420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745db3a-1dcc-4c0e-86a7-cf7c612e1bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b745db3a-1dcc-4c0e-86a7-cf7c612e1bfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:57:48.171886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:57:48.172971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:57:48.173902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 589/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:57:48.179606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85700b1-471a-443f-8632-69fa77ec6bb1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:48.269738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85700b1-471a-443f-8632-69fa77ec6bb1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:48.300780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00364d0e-2839-4e42-a6df-da831adda7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:48.301433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00364d0e-2839-4e42-a6df-da831adda7fb None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:48.301711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00364d0e-2839-4e42-a6df-da831adda7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:48.301982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00364d0e-2839-4e42-a6df-da831adda7fb None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:48.303334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00364d0e-2839-4e42-a6df-da831adda7fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:48.303638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00364d0e-2839-4e42-a6df-da831adda7fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:48.304999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00364d0e-2839-4e42-a6df-da831adda7fb None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:48.312496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 607/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:48.318455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745db3a-1dcc-4c0e-86a7-cf7c612e1bfa None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:48.411182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745db3a-1dcc-4c0e-86a7-cf7c612e1bfa None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:48.443070 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d940390-e388-48fa-bcf6-0c9ecd7f11b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:48.443899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d940390-e388-48fa-bcf6-0c9ecd7f11b6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:48.444170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d940390-e388-48fa-bcf6-0c9ecd7f11b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:48.444431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d940390-e388-48fa-bcf6-0c9ecd7f11b6 None admin] PATH_INFO: `/v3/users/90ff984e0b6648599d07e52292f11bd4` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:48.445582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d940390-e388-48fa-bcf6-0c9ecd7f11b6 None admin] RBAC: Authorizing `identity:get_user(user_id=90ff984e0b6648599d07e52292f11bd4)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:48.447065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d940390-e388-48fa-bcf6-0c9ecd7f11b6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:48.448645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 590/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Mon May 16 14:57:48 2022] GET /identity/v3/users/90ff984e0b6648599d07e52292f11bd4 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:48.454353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00364d0e-2839-4e42-a6df-da831adda7fb None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:48.546504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00364d0e-2839-4e42-a6df-da831adda7fb None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:48.577118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1782-2f3c-400b-a336-c828fcea3b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:48.577742 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1782-2f3c-400b-a336-c828fcea3b94 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:48.578021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1782-2f3c-400b-a336-c828fcea3b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:48.578325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1782-2f3c-400b-a336-c828fcea3b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:48.639655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce1782-2f3c-400b-a336-c828fcea3b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:48.641073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce1782-2f3c-400b-a336-c828fcea3b94 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:48.730995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 608/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:57:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:57:48.736672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d940390-e388-48fa-bcf6-0c9ecd7f11b6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:48.829368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d940390-e388-48fa-bcf6-0c9ecd7f11b6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:48.861040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4d343-3cff-4174-9604-a3d2dfb372c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:48.861870 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d343-3cff-4174-9604-a3d2dfb372c5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:48.862178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d343-3cff-4174-9604-a3d2dfb372c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:48.862453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d343-3cff-4174-9604-a3d2dfb372c5 None admin] PATH_INFO: `/v3/projects/81bb6b783dc24eac926722370b12fb85` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:48.863606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4d343-3cff-4174-9604-a3d2dfb372c5 None admin] RBAC: Authorizing `identity:get_project(project_id=81bb6b783dc24eac926722370b12fb85)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:48.865097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4d343-3cff-4174-9604-a3d2dfb372c5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:48.867290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 591/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Mon May 16 14:57:48 2022] GET /identity/v3/projects/81bb6b783dc24eac926722370b12fb85 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:57:48.873166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1782-2f3c-400b-a336-c828fcea3b94 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:57:48.971720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1782-2f3c-400b-a336-c828fcea3b94 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:57:49.003487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d2601-2b78-47bd-9666-a9134cc13667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:57:49.004063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2601-2b78-47bd-9666-a9134cc13667 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:57:49.004337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2601-2b78-47bd-9666-a9134cc13667 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:57:49.004604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d2601-2b78-47bd-9666-a9134cc13667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:57:49.005415 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d2601-2b78-47bd-9666-a9134cc13667 None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=81bb6b783dc24eac926722370b12fb85, user.id=90ff984e0b6648599d07e52292f11bd4) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:57:49.005721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d2601-2b78-47bd-9666-a9134cc13667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:57:49.007167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d2601-2b78-47bd-9666-a9134cc13667 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:57:49.012742 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 609/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:57:48 2022] GET /identity/v3/role_assignments?user.id=90ff984e0b6648599d07e52292f11bd4&scope.project.id=81bb6b783dc24eac926722370b12fb85&role.id=042169a166e14a80beac826291ceaf73 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:06.217091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89abd4-7189-42cc-b3a5-1290858c885d None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:06.217686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89abd4-7189-42cc-b3a5-1290858c885d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:06.217686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89abd4-7189-42cc-b3a5-1290858c885d None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:06.219078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 592/1201] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:06.224658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c24bf-6180-4376-972a-d5de9002e838 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:06.225077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c24bf-6180-4376-972a-d5de9002e838 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:06.225204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c24bf-6180-4376-972a-d5de9002e838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:06.241262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f41c24bf-6180-4376-972a-d5de9002e838 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:06.242458 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f41c24bf-6180-4376-972a-d5de9002e838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:06.304608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 610/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 14:59:06.330104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89abd4-7189-42cc-b3a5-1290858c885d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:06.424958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89abd4-7189-42cc-b3a5-1290858c885d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:06.457223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4967e6-7b9c-4bc6-9a6e-01ccd11ab9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:06.458000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4967e6-7b9c-4bc6-9a6e-01ccd11ab9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:06.458309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4967e6-7b9c-4bc6-9a6e-01ccd11ab9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:06.458583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4967e6-7b9c-4bc6-9a6e-01ccd11ab9c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:06.468165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4967e6-7b9c-4bc6-9a6e-01ccd11ab9c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:06.469603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4967e6-7b9c-4bc6-9a6e-01ccd11ab9c8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0b4967e6-7b9c-4bc6-9a6e-01ccd11ab9c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:06.486976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:06.488100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:06.489261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:06.489261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:06.489261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:06.489261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:06.489261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 593/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:06.494135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c24bf-6180-4376-972a-d5de9002e838 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:06.587833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c24bf-6180-4376-972a-d5de9002e838 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:06.619199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d498d32-1810-4b25-bae7-1fc3d1dfd915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:06.619843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d498d32-1810-4b25-bae7-1fc3d1dfd915 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:06.620164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d498d32-1810-4b25-bae7-1fc3d1dfd915 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:06.620969 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d498d32-1810-4b25-bae7-1fc3d1dfd915 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:06.621680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d498d32-1810-4b25-bae7-1fc3d1dfd915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:06.621981 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d498d32-1810-4b25-bae7-1fc3d1dfd915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:06.623366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d498d32-1810-4b25-bae7-1fc3d1dfd915 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:06.633883 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 611/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:06.639600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4967e6-7b9c-4bc6-9a6e-01ccd11ab9c8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:06.733541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4967e6-7b9c-4bc6-9a6e-01ccd11ab9c8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:06.766281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1fc57-311b-48fd-aa43-90319d00847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:06.766939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1fc57-311b-48fd-aa43-90319d00847b None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:06.767222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1fc57-311b-48fd-aa43-90319d00847b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:06.767495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1fc57-311b-48fd-aa43-90319d00847b None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:06.768196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1fc57-311b-48fd-aa43-90319d00847b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:06.769612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1fc57-311b-48fd-aa43-90319d00847b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:06.862115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 594/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Mon May 16 14:59:06 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:59:09.087378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b77a03-459a-477b-b28f-d6a3fbabcbda None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:09.087785 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b77a03-459a-477b-b28f-d6a3fbabcbda None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:09.087920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b77a03-459a-477b-b28f-d6a3fbabcbda None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:09.089857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 612/1206] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:09.095292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993014d-c674-4a39-9d90-c4301a02f8e1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:09.095694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993014d-c674-4a39-9d90-c4301a02f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:09.095836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993014d-c674-4a39-9d90-c4301a02f8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:09.113847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f993014d-c674-4a39-9d90-c4301a02f8e1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:09.121329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f993014d-c674-4a39-9d90-c4301a02f8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:09.177596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 595/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:09.200726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b77a03-459a-477b-b28f-d6a3fbabcbda None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:09.296202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b77a03-459a-477b-b28f-d6a3fbabcbda None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:09.326437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb71e8f-1745-487b-b6cc-085140b1008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:09.327210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb71e8f-1745-487b-b6cc-085140b1008d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:09.327486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb71e8f-1745-487b-b6cc-085140b1008d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:09.327756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb71e8f-1745-487b-b6cc-085140b1008d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:09.340324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb71e8f-1745-487b-b6cc-085140b1008d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-cdb71e8f-1745-487b-b6cc-085140b1008d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:59:09.345831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:09.346880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:09.348234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 613/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:59:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:09.353258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993014d-c674-4a39-9d90-c4301a02f8e1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:09.445198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993014d-c674-4a39-9d90-c4301a02f8e1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:09.479423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083cb97-d0f8-4188-a5a9-065a095f0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:09.480100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083cb97-d0f8-4188-a5a9-065a095f0912 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:09.480374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083cb97-d0f8-4188-a5a9-065a095f0912 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:09.480643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083cb97-d0f8-4188-a5a9-065a095f0912 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:09.481367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083cb97-d0f8-4188-a5a9-065a095f0912 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:09.481665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083cb97-d0f8-4188-a5a9-065a095f0912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:09.483120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083cb97-d0f8-4188-a5a9-065a095f0912 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:09.490611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 596/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:59:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:09.496361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb71e8f-1745-487b-b6cc-085140b1008d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:09.590079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb71e8f-1745-487b-b6cc-085140b1008d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:09.622589 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba9fb5-08e5-45d0-9b7e-e9d6bd5abc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:09.623298 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba9fb5-08e5-45d0-9b7e-e9d6bd5abc92 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:09.623575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba9fb5-08e5-45d0-9b7e-e9d6bd5abc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:09.623842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba9fb5-08e5-45d0-9b7e-e9d6bd5abc92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:09.633468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba9fb5-08e5-45d0-9b7e-e9d6bd5abc92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:09.634922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba9fb5-08e5-45d0-9b7e-e9d6bd5abc92 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-a0ba9fb5-08e5-45d0-9b7e-e9d6bd5abc92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:09.652827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:09.653849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:09.654795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:09.654795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:09.654795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:09.654795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:09.654795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 614/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:09.659801 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083cb97-d0f8-4188-a5a9-065a095f0912 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:09.755541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083cb97-d0f8-4188-a5a9-065a095f0912 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:09.787672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd366e-40bd-4936-8ac6-517d3084872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:09.788316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd366e-40bd-4936-8ac6-517d3084872a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:09.788598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd366e-40bd-4936-8ac6-517d3084872a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:09.788867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd366e-40bd-4936-8ac6-517d3084872a None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:09.789583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd366e-40bd-4936-8ac6-517d3084872a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:09.789863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd366e-40bd-4936-8ac6-517d3084872a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:09.791243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd366e-40bd-4936-8ac6-517d3084872a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:09.802410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 597/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:09.808671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba9fb5-08e5-45d0-9b7e-e9d6bd5abc92 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:09.901778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba9fb5-08e5-45d0-9b7e-e9d6bd5abc92 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:09.932535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d15deb-c069-4a98-8928-7c0a83d32f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:09.933816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d15deb-c069-4a98-8928-7c0a83d32f12 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:09.934122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d15deb-c069-4a98-8928-7c0a83d32f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:09.934393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d15deb-c069-4a98-8928-7c0a83d32f12 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:09.941056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d15deb-c069-4a98-8928-7c0a83d32f12 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:09.942596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d15deb-c069-4a98-8928-7c0a83d32f12 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-38d15deb-c069-4a98-8928-7c0a83d32f12 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:59:09.957198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:09.958550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:09.959705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 615/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:09.964412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd366e-40bd-4936-8ac6-517d3084872a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:10.057523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd366e-40bd-4936-8ac6-517d3084872a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:10.094210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075712e2-75c1-429c-9c2f-3b7da16e56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:10.094873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075712e2-75c1-429c-9c2f-3b7da16e56a2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:10.095154 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075712e2-75c1-429c-9c2f-3b7da16e56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:10.095428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075712e2-75c1-429c-9c2f-3b7da16e56a2 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:10.096248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075712e2-75c1-429c-9c2f-3b7da16e56a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:10.096552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075712e2-75c1-429c-9c2f-3b7da16e56a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:10.097964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075712e2-75c1-429c-9c2f-3b7da16e56a2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:10.114662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 598/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 16 14:59:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:10.120975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d15deb-c069-4a98-8928-7c0a83d32f12 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:10.213557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d15deb-c069-4a98-8928-7c0a83d32f12 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:10.245781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94644101-b8db-4d77-a0d8-d3dabec7f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:10.246442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94644101-b8db-4d77-a0d8-d3dabec7f398 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:10.246725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94644101-b8db-4d77-a0d8-d3dabec7f398 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:10.246999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94644101-b8db-4d77-a0d8-d3dabec7f398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:10.310344 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94644101-b8db-4d77-a0d8-d3dabec7f398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:10.311788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94644101-b8db-4d77-a0d8-d3dabec7f398 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:10.403318 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 616/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:59:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:59:10.409293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075712e2-75c1-429c-9c2f-3b7da16e56a2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:10.505338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075712e2-75c1-429c-9c2f-3b7da16e56a2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:10.537175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129d14-b9ba-48e9-9c0b-9fe0221eb376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:10.537950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129d14-b9ba-48e9-9c0b-9fe0221eb376 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:10.538258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129d14-b9ba-48e9-9c0b-9fe0221eb376 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:10.538530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129d14-b9ba-48e9-9c0b-9fe0221eb376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:10.548636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63129d14-b9ba-48e9-9c0b-9fe0221eb376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:10.550067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63129d14-b9ba-48e9-9c0b-9fe0221eb376 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-63129d14-b9ba-48e9-9c0b-9fe0221eb376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:10.567405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:10.570593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:10.571728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:10.571728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:10.571728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:10.571728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:10.571728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 599/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:10.574357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94644101-b8db-4d77-a0d8-d3dabec7f398 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:10.665564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94644101-b8db-4d77-a0d8-d3dabec7f398 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:10.697216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c912e2-c1f3-4679-9bdf-7af818263a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:10.697861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c912e2-c1f3-4679-9bdf-7af818263a2d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:10.698164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c912e2-c1f3-4679-9bdf-7af818263a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:10.698595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c912e2-c1f3-4679-9bdf-7af818263a2d None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:10.699377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c912e2-c1f3-4679-9bdf-7af818263a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:10.699693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c912e2-c1f3-4679-9bdf-7af818263a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:10.701124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c912e2-c1f3-4679-9bdf-7af818263a2d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:10.711765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 617/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:10.717773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129d14-b9ba-48e9-9c0b-9fe0221eb376 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:10.812584 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129d14-b9ba-48e9-9c0b-9fe0221eb376 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:10.845648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7066c72-b4d8-4d43-be14-ad9f2900ed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:10.846456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7066c72-b4d8-4d43-be14-ad9f2900ed37 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:10.846735 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7066c72-b4d8-4d43-be14-ad9f2900ed37 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:10.847003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7066c72-b4d8-4d43-be14-ad9f2900ed37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:10.853680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7066c72-b4d8-4d43-be14-ad9f2900ed37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:10.855750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7066c72-b4d8-4d43-be14-ad9f2900ed37 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-d7066c72-b4d8-4d43-be14-ad9f2900ed37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:59:10.868958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:10.869988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:10.871089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:59:10.871089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:59:10.871089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:59:10.871089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:59:10.871089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:59:10.871089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:59:10.871089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:10.871089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:10.871089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 600/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:10.876061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c912e2-c1f3-4679-9bdf-7af818263a2d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:10.969852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c912e2-c1f3-4679-9bdf-7af818263a2d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:11.000776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c4abf-6806-4470-b4ed-207b506608ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:11.002762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c4abf-6806-4470-b4ed-207b506608ef None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:11.002762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c4abf-6806-4470-b4ed-207b506608ef None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:11.002762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c4abf-6806-4470-b4ed-207b506608ef None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:11.002762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c4abf-6806-4470-b4ed-207b506608ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:11.003159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c4abf-6806-4470-b4ed-207b506608ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:11.004450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c4abf-6806-4470-b4ed-207b506608ef None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:11.016526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 618/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:59:11.022640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7066c72-b4d8-4d43-be14-ad9f2900ed37 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:11.116472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7066c72-b4d8-4d43-be14-ad9f2900ed37 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:11.147949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0cd7a-6c99-4fb4-b7d1-7a7d1e35086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:11.148590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0cd7a-6c99-4fb4-b7d1-7a7d1e35086e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:11.148872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0cd7a-6c99-4fb4-b7d1-7a7d1e35086e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:11.149181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0cd7a-6c99-4fb4-b7d1-7a7d1e35086e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:11.150649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0cd7a-6c99-4fb4-b7d1-7a7d1e35086e None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=6dfdb39ae2804b2191cea53f2a387c3e) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:11.151206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0cd7a-6c99-4fb4-b7d1-7a7d1e35086e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:11.154542 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0cd7a-6c99-4fb4-b7d1-7a7d1e35086e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:11.162619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 601/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:59:11 2022] GET /identity/v3/role_assignments?user.id=6dfdb39ae2804b2191cea53f2a387c3e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:13.330306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4c2e3-3222-44c4-8d07-be007a8fecdd None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:13.330830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4c2e3-3222-44c4-8d07-be007a8fecdd None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:13.330830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4c2e3-3222-44c4-8d07-be007a8fecdd None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:13.332216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 619/1220] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:13.337248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce07c5-dec9-4da3-86e9-23c8eeaf5e25 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:13.340110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce07c5-dec9-4da3-86e9-23c8eeaf5e25 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:13.340110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce07c5-dec9-4da3-86e9-23c8eeaf5e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:13.355231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bcce07c5-dec9-4da3-86e9-23c8eeaf5e25 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:13.356404 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bcce07c5-dec9-4da3-86e9-23c8eeaf5e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:13.418926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 602/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:13.441616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4c2e3-3222-44c4-8d07-be007a8fecdd None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:13.538369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4c2e3-3222-44c4-8d07-be007a8fecdd None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:13.570654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efa711-23e0-4804-ac67-45ab8fcd690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:13.571431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efa711-23e0-4804-ac67-45ab8fcd690d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:13.571709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efa711-23e0-4804-ac67-45ab8fcd690d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:13.572008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efa711-23e0-4804-ac67-45ab8fcd690d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:13.582279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efa711-23e0-4804-ac67-45ab8fcd690d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-40efa711-23e0-4804-ac67-45ab8fcd690d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:59:13.589796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:13.590913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:13.591950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 620/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:59:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:13.596958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce07c5-dec9-4da3-86e9-23c8eeaf5e25 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:13.690697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce07c5-dec9-4da3-86e9-23c8eeaf5e25 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:13.722910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10d021-7fc7-42b4-804b-225af7009170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:13.723818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10d021-7fc7-42b4-804b-225af7009170 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:13.724092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10d021-7fc7-42b4-804b-225af7009170 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:13.724359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10d021-7fc7-42b4-804b-225af7009170 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:13.725081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10d021-7fc7-42b4-804b-225af7009170 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:13.725380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10d021-7fc7-42b4-804b-225af7009170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:13.726760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10d021-7fc7-42b4-804b-225af7009170 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:13.734431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 603/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:59:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:13.740249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efa711-23e0-4804-ac67-45ab8fcd690d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:13.834830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efa711-23e0-4804-ac67-45ab8fcd690d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:13.866428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccf630-1a04-4fdb-9cda-49cb59202a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:13.867199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccf630-1a04-4fdb-9cda-49cb59202a70 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:13.867478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccf630-1a04-4fdb-9cda-49cb59202a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:13.867748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccf630-1a04-4fdb-9cda-49cb59202a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:13.878273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccf630-1a04-4fdb-9cda-49cb59202a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:13.879717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccf630-1a04-4fdb-9cda-49cb59202a70 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-22ccf630-1a04-4fdb-9cda-49cb59202a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:13.896573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:13.897602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:13.898818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:13.898818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:13.898818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:13.898818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:13.898818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 621/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:13.903552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10d021-7fc7-42b4-804b-225af7009170 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:13.997834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10d021-7fc7-42b4-804b-225af7009170 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:14.031130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f5f13-9235-44d2-bb42-35d18a96bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:14.031788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f5f13-9235-44d2-bb42-35d18a96bda6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:14.032070 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f5f13-9235-44d2-bb42-35d18a96bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:14.032350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f5f13-9235-44d2-bb42-35d18a96bda6 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:14.033063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f5f13-9235-44d2-bb42-35d18a96bda6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:14.033370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f5f13-9235-44d2-bb42-35d18a96bda6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:14.034769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f5f13-9235-44d2-bb42-35d18a96bda6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:14.045975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 604/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:14.051647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccf630-1a04-4fdb-9cda-49cb59202a70 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:14.145677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccf630-1a04-4fdb-9cda-49cb59202a70 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:14.177065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c573647-272b-47ec-be1c-169391bb0d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:14.177833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c573647-272b-47ec-be1c-169391bb0d6d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:14.178136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c573647-272b-47ec-be1c-169391bb0d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:14.178408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c573647-272b-47ec-be1c-169391bb0d6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:14.185448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c573647-272b-47ec-be1c-169391bb0d6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:14.186927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c573647-272b-47ec-be1c-169391bb0d6d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-5c573647-272b-47ec-be1c-169391bb0d6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:59:14.201167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:14.202296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:14.203588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 622/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:14.208055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f5f13-9235-44d2-bb42-35d18a96bda6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:14.303779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f5f13-9235-44d2-bb42-35d18a96bda6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:14.336647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bd7e2-fb1d-46c9-9086-969ae9bb6ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:14.337307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd7e2-fb1d-46c9-9086-969ae9bb6ddf None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:14.337853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd7e2-fb1d-46c9-9086-969ae9bb6ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:14.337853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd7e2-fb1d-46c9-9086-969ae9bb6ddf None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:14.338710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bd7e2-fb1d-46c9-9086-969ae9bb6ddf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:14.339515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bd7e2-fb1d-46c9-9086-969ae9bb6ddf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:14.340952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bd7e2-fb1d-46c9-9086-969ae9bb6ddf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:14.358679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 605/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 16 14:59:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:14.364308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c573647-272b-47ec-be1c-169391bb0d6d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:14.457935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c573647-272b-47ec-be1c-169391bb0d6d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:14.490494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00038b6-8843-4a46-aafc-67d6cbbf5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:14.491294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00038b6-8843-4a46-aafc-67d6cbbf5f67 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:14.491571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00038b6-8843-4a46-aafc-67d6cbbf5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:14.491839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00038b6-8843-4a46-aafc-67d6cbbf5f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:14.501689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00038b6-8843-4a46-aafc-67d6cbbf5f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:14.503151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00038b6-8843-4a46-aafc-67d6cbbf5f67 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-c00038b6-8843-4a46-aafc-67d6cbbf5f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:14.519184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:14.520304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:14.521407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:14.521407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:14.521407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:14.521407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:14.521407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 623/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:14.526256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bd7e2-fb1d-46c9-9086-969ae9bb6ddf None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:14.621278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bd7e2-fb1d-46c9-9086-969ae9bb6ddf None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:14.653247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe27d5-c0ff-47e2-b29f-f7126b35a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:14.653895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe27d5-c0ff-47e2-b29f-f7126b35a612 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:14.654204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe27d5-c0ff-47e2-b29f-f7126b35a612 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:14.654477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe27d5-c0ff-47e2-b29f-f7126b35a612 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:14.655257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe27d5-c0ff-47e2-b29f-f7126b35a612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:14.655556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe27d5-c0ff-47e2-b29f-f7126b35a612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:14.656909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe27d5-c0ff-47e2-b29f-f7126b35a612 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:14.668214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 606/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:14.673987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00038b6-8843-4a46-aafc-67d6cbbf5f67 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:14.766403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00038b6-8843-4a46-aafc-67d6cbbf5f67 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:14.797429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a6166-ad4c-4382-9828-4da6e1b59009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:14.798255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6166-ad4c-4382-9828-4da6e1b59009 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:14.798535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6166-ad4c-4382-9828-4da6e1b59009 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:14.798806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6166-ad4c-4382-9828-4da6e1b59009 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:14.805114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a6166-ad4c-4382-9828-4da6e1b59009 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:14.806577 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a6166-ad4c-4382-9828-4da6e1b59009 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-2f3a6166-ad4c-4382-9828-4da6e1b59009 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:59:14.820137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:14.824926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:14.825920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:59:14.825920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:59:14.825920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:59:14.825920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:59:14.825920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:59:14.825920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:59:14.825920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:14.825920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:14.825920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 624/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:14.828620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe27d5-c0ff-47e2-b29f-f7126b35a612 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:14.925378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe27d5-c0ff-47e2-b29f-f7126b35a612 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:14.957059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a2689-b3e5-4f2f-ad8b-22aefb1ee84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:14.957703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2689-b3e5-4f2f-ad8b-22aefb1ee84f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:14.958025 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2689-b3e5-4f2f-ad8b-22aefb1ee84f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:14.958321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a2689-b3e5-4f2f-ad8b-22aefb1ee84f None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:14.959082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a2689-b3e5-4f2f-ad8b-22aefb1ee84f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:14.959383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a2689-b3e5-4f2f-ad8b-22aefb1ee84f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:14.960783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a2689-b3e5-4f2f-ad8b-22aefb1ee84f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:14.972260 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 607/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:14.978509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a6166-ad4c-4382-9828-4da6e1b59009 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:15.073111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a6166-ad4c-4382-9828-4da6e1b59009 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:15.105967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cb941-7784-4e54-a10d-8dd037e820d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:15.106904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cb941-7784-4e54-a10d-8dd037e820d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:15.107182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cb941-7784-4e54-a10d-8dd037e820d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:15.107451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cb941-7784-4e54-a10d-8dd037e820d6 None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/6dfdb39ae2804b2191cea53f2a387c3e/roles/4235f90e4db94284adec59aa60035bf6` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:15.120742 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cb941-7784-4e54-a10d-8dd037e820d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=6dfdb39ae2804b2191cea53f2a387c3e, role_id=4235f90e4db94284adec59aa60035bf6)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:15.122207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cb941-7784-4e54-a10d-8dd037e820d6 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:15.198930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 625/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:59:14 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/6dfdb39ae2804b2191cea53f2a387c3e/roles/4235f90e4db94284adec59aa60035bf6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:59:17.372049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227411c-2814-4e98-804b-affe85c85bd2 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:17.372565 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227411c-2814-4e98-804b-affe85c85bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:17.372565 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227411c-2814-4e98-804b-affe85c85bd2 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:17.373880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 608/1233] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:17.379066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7e871-ba15-4df0-9ba9-d3c33d2599c3 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:17.379455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7e871-ba15-4df0-9ba9-d3c33d2599c3 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:17.379614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7e871-ba15-4df0-9ba9-d3c33d2599c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:17.396030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-59f7e871-ba15-4df0-9ba9-d3c33d2599c3 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:17.397200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-59f7e871-ba15-4df0-9ba9-d3c33d2599c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:17.459856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 626/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:17.483203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227411c-2814-4e98-804b-affe85c85bd2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:17.580054 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227411c-2814-4e98-804b-affe85c85bd2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:17.612492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161ac23-2ebd-472b-b4b9-28ef71f2a817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:17.613276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161ac23-2ebd-472b-b4b9-28ef71f2a817 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:17.613552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161ac23-2ebd-472b-b4b9-28ef71f2a817 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:17.613820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161ac23-2ebd-472b-b4b9-28ef71f2a817 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:17.626089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161ac23-2ebd-472b-b4b9-28ef71f2a817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c161ac23-2ebd-472b-b4b9-28ef71f2a817 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:59:17.632505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:17.633638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:17.634724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 609/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Mon May 16 14:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:59:17.640608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7e871-ba15-4df0-9ba9-d3c33d2599c3 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:17.733150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7e871-ba15-4df0-9ba9-d3c33d2599c3 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:17.764556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a663-28b6-4044-b5e9-82a02a304db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:17.765210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a663-28b6-4044-b5e9-82a02a304db7 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:17.765484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a663-28b6-4044-b5e9-82a02a304db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:17.765754 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a663-28b6-4044-b5e9-82a02a304db7 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:17.766529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0a663-28b6-4044-b5e9-82a02a304db7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:17.766833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0a663-28b6-4044-b5e9-82a02a304db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:17.772498 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0a663-28b6-4044-b5e9-82a02a304db7 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:17.776038 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 627/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Mon May 16 14:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:17.781836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161ac23-2ebd-472b-b4b9-28ef71f2a817 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:17.876313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161ac23-2ebd-472b-b4b9-28ef71f2a817 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:17.907336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4b5d1-5194-469b-8923-476a1ddce052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:17.908110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4b5d1-5194-469b-8923-476a1ddce052 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:17.908389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4b5d1-5194-469b-8923-476a1ddce052 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:17.908660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4b5d1-5194-469b-8923-476a1ddce052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:17.920005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4b5d1-5194-469b-8923-476a1ddce052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:17.921443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4b5d1-5194-469b-8923-476a1ddce052 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9ca4b5d1-5194-469b-8923-476a1ddce052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:17.938305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:17.939243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:17.940344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:17.940344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:17.940344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:17.940344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:17.940344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 610/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:17.945157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a663-28b6-4044-b5e9-82a02a304db7 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:18.042063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a663-28b6-4044-b5e9-82a02a304db7 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:18.073783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937061b-8638-4373-93af-453f7f74e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:18.074465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937061b-8638-4373-93af-453f7f74e150 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:18.074748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937061b-8638-4373-93af-453f7f74e150 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:18.075020 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937061b-8638-4373-93af-453f7f74e150 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:18.075737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937061b-8638-4373-93af-453f7f74e150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:18.076038 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937061b-8638-4373-93af-453f7f74e150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:18.077402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937061b-8638-4373-93af-453f7f74e150 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:18.088311 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 628/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:18.094424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4b5d1-5194-469b-8923-476a1ddce052 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:18.188446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4b5d1-5194-469b-8923-476a1ddce052 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:18.219775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd6e08-8bad-4e5e-9674-9947b6857687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:18.220553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd6e08-8bad-4e5e-9674-9947b6857687 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:18.220827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd6e08-8bad-4e5e-9674-9947b6857687 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:18.221095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd6e08-8bad-4e5e-9674-9947b6857687 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:18.228703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd6e08-8bad-4e5e-9674-9947b6857687 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:18.230781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd6e08-8bad-4e5e-9674-9947b6857687 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-24fd6e08-8bad-4e5e-9674-9947b6857687 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:59:18.244756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:18.245960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:18.246974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 611/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:18.251912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937061b-8638-4373-93af-453f7f74e150 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:18.345502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937061b-8638-4373-93af-453f7f74e150 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:18.377632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc74411-a95c-4b56-bb85-d818dd5b1405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:18.378442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc74411-a95c-4b56-bb85-d818dd5b1405 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:18.378723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc74411-a95c-4b56-bb85-d818dd5b1405 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:18.378990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc74411-a95c-4b56-bb85-d818dd5b1405 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:18.379864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc74411-a95c-4b56-bb85-d818dd5b1405 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:18.380416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc74411-a95c-4b56-bb85-d818dd5b1405 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:18.381667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc74411-a95c-4b56-bb85-d818dd5b1405 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:18.398277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 629/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 16 14:59:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:59:18.404586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd6e08-8bad-4e5e-9674-9947b6857687 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:18.500520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd6e08-8bad-4e5e-9674-9947b6857687 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:18.533294 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e529-1c64-4610-8e46-269ff797681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:18.533933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e529-1c64-4610-8e46-269ff797681b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:18.534232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e529-1c64-4610-8e46-269ff797681b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:18.534505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e529-1c64-4610-8e46-269ff797681b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:18.599914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e529-1c64-4610-8e46-269ff797681b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:18.601393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e529-1c64-4610-8e46-269ff797681b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:18.691624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 612/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:59:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:59:18.697479 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc74411-a95c-4b56-bb85-d818dd5b1405 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:18.790292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc74411-a95c-4b56-bb85-d818dd5b1405 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:18.822122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac4fad-4657-45d6-bced-8098b2ecfe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:18.822941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac4fad-4657-45d6-bced-8098b2ecfe23 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:18.823219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac4fad-4657-45d6-bced-8098b2ecfe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:18.824105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac4fad-4657-45d6-bced-8098b2ecfe23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:18.835271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac4fad-4657-45d6-bced-8098b2ecfe23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:18.836718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac4fad-4657-45d6-bced-8098b2ecfe23 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-51ac4fad-4657-45d6-bced-8098b2ecfe23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:18.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:18.854829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:18.855930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:18.855930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:18.855930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:18.855930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:18.855930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 630/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:18.861749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e529-1c64-4610-8e46-269ff797681b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:18.956012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e529-1c64-4610-8e46-269ff797681b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:18.987386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d3048-2b68-4c4f-960e-8b3340649acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:18.988147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d3048-2b68-4c4f-960e-8b3340649acc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:18.988425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d3048-2b68-4c4f-960e-8b3340649acc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:18.988697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d3048-2b68-4c4f-960e-8b3340649acc None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:18.989397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d3048-2b68-4c4f-960e-8b3340649acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:18.989697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d3048-2b68-4c4f-960e-8b3340649acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:18.991072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d3048-2b68-4c4f-960e-8b3340649acc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:19.003179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 613/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:59:19.007869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac4fad-4657-45d6-bced-8098b2ecfe23 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:19.102704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac4fad-4657-45d6-bced-8098b2ecfe23 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:19.134809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be8a3f-1fd3-4f00-beb5-f4fb5cc1056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:19.135580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8a3f-1fd3-4f00-beb5-f4fb5cc1056f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:19.135856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8a3f-1fd3-4f00-beb5-f4fb5cc1056f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:19.136709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8a3f-1fd3-4f00-beb5-f4fb5cc1056f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:19.143160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be8a3f-1fd3-4f00-beb5-f4fb5cc1056f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:19.144580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be8a3f-1fd3-4f00-beb5-f4fb5cc1056f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-39be8a3f-1fd3-4f00-beb5-f4fb5cc1056f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:59:19.157600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:19.158719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:19.160009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:59:19.160009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:59:19.160009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:59:19.160009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:59:19.160009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:59:19.160009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:59:19.160009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:19.160009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:19.160009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 631/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:19.164695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d3048-2b68-4c4f-960e-8b3340649acc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:19.261994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d3048-2b68-4c4f-960e-8b3340649acc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:19.293467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1106a-d211-41d6-8ee0-1d91e22faed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:19.294135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1106a-d211-41d6-8ee0-1d91e22faed9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:19.294414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1106a-d211-41d6-8ee0-1d91e22faed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:19.294786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1106a-d211-41d6-8ee0-1d91e22faed9 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:19.295493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1106a-d211-41d6-8ee0-1d91e22faed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:19.295793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1106a-d211-41d6-8ee0-1d91e22faed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:19.297219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1106a-d211-41d6-8ee0-1d91e22faed9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:19.309215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 614/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:19.315567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be8a3f-1fd3-4f00-beb5-f4fb5cc1056f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:19.409518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be8a3f-1fd3-4f00-beb5-f4fb5cc1056f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:19.441623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9522-7d83-4d3d-83a3-9ec03cdc04bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:19.442307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9522-7d83-4d3d-83a3-9ec03cdc04bb None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:19.442581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9522-7d83-4d3d-83a3-9ec03cdc04bb None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:19.442849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9522-7d83-4d3d-83a3-9ec03cdc04bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:19.443662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9522-7d83-4d3d-83a3-9ec03cdc04bb None admin] RBAC: Adding query filter params (role.id=4235f90e4db94284adec59aa60035bf6, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=6dfdb39ae2804b2191cea53f2a387c3e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:19.443965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9522-7d83-4d3d-83a3-9ec03cdc04bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:19.445452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9522-7d83-4d3d-83a3-9ec03cdc04bb None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:19.451039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 632/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:59:19 2022] GET /identity/v3/role_assignments?user.id=6dfdb39ae2804b2191cea53f2a387c3e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=4235f90e4db94284adec59aa60035bf6 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:21.713287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca082c8e-1f38-484c-a6c3-25d79c80545a None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:21.713837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca082c8e-1f38-484c-a6c3-25d79c80545a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:21.713837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca082c8e-1f38-484c-a6c3-25d79c80545a None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:21.715824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 615/1247] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:21.721097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cead235-3521-4e59-9919-5cd7067c218a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:21.721473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cead235-3521-4e59-9919-5cd7067c218a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:21.721649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cead235-3521-4e59-9919-5cd7067c218a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:21.738787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-1cead235-3521-4e59-9919-5cd7067c218a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:21.739996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1cead235-3521-4e59-9919-5cd7067c218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:21.803911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 633/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:21.828280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca082c8e-1f38-484c-a6c3-25d79c80545a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:21.923148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca082c8e-1f38-484c-a6c3-25d79c80545a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:21.955953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e7d74-a3c0-480a-be44-e44c01a23b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:21.956731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e7d74-a3c0-480a-be44-e44c01a23b2e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:21.957015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e7d74-a3c0-480a-be44-e44c01a23b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:21.957285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e7d74-a3c0-480a-be44-e44c01a23b2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:21.967524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e7d74-a3c0-480a-be44-e44c01a23b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-3b8e7d74-a3c0-480a-be44-e44c01a23b2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:59:21.975201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:21.978215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:21.979258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 616/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:59:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:21.983039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cead235-3521-4e59-9919-5cd7067c218a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:22.075482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cead235-3521-4e59-9919-5cd7067c218a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:22.108204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8811e-5cd3-4d4a-8915-1c84f3b74800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:22.108856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8811e-5cd3-4d4a-8915-1c84f3b74800 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:22.109129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8811e-5cd3-4d4a-8915-1c84f3b74800 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:22.109394 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8811e-5cd3-4d4a-8915-1c84f3b74800 None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:22.110162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8811e-5cd3-4d4a-8915-1c84f3b74800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:22.110464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8811e-5cd3-4d4a-8915-1c84f3b74800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:22.111928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8811e-5cd3-4d4a-8915-1c84f3b74800 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:22.119466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 634/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:22.125158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e7d74-a3c0-480a-be44-e44c01a23b2e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:22.218644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e7d74-a3c0-480a-be44-e44c01a23b2e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:22.249857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff7ac-181a-4350-a79b-bf7d76089a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:22.250662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff7ac-181a-4350-a79b-bf7d76089a85 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:22.250944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff7ac-181a-4350-a79b-bf7d76089a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:22.251218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff7ac-181a-4350-a79b-bf7d76089a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:22.261808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff7ac-181a-4350-a79b-bf7d76089a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:22.263288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff7ac-181a-4350-a79b-bf7d76089a85 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ed5ff7ac-181a-4350-a79b-bf7d76089a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:22.280204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:22.281256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:22.282238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:22.282238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:22.282238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:22.282238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:22.282238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 617/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:59:22.287141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8811e-5cd3-4d4a-8915-1c84f3b74800 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:22.380093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8811e-5cd3-4d4a-8915-1c84f3b74800 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:22.411629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15154d-3d7f-4088-a812-a638a04e8525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:22.412270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15154d-3d7f-4088-a812-a638a04e8525 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:22.412552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15154d-3d7f-4088-a812-a638a04e8525 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:22.412820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15154d-3d7f-4088-a812-a638a04e8525 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:22.413523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15154d-3d7f-4088-a812-a638a04e8525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:22.413821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15154d-3d7f-4088-a812-a638a04e8525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:22.415264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15154d-3d7f-4088-a812-a638a04e8525 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:22.426306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 635/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:59:22.431986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff7ac-181a-4350-a79b-bf7d76089a85 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:22.527198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff7ac-181a-4350-a79b-bf7d76089a85 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:22.558287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d9c9-8da6-431e-9951-f19d9ba74396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:22.559071 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d9c9-8da6-431e-9951-f19d9ba74396 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:22.559857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d9c9-8da6-431e-9951-f19d9ba74396 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:22.560131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7d9c9-8da6-431e-9951-f19d9ba74396 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:22.567381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7d9c9-8da6-431e-9951-f19d9ba74396 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:22.568817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7d9c9-8da6-431e-9951-f19d9ba74396 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e9d7d9c9-8da6-431e-9951-f19d9ba74396 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:59:22.583178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:22.584286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:22.590116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 618/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:22.590839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15154d-3d7f-4088-a812-a638a04e8525 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:22.682370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15154d-3d7f-4088-a812-a638a04e8525 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:22.714818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ca020-a12f-4842-ada4-b965c0e6424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:22.715507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca020-a12f-4842-ada4-b965c0e6424e None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:22.715790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca020-a12f-4842-ada4-b965c0e6424e None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:22.716057 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca020-a12f-4842-ada4-b965c0e6424e None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:22.716872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ca020-a12f-4842-ada4-b965c0e6424e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:22.717174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ca020-a12f-4842-ada4-b965c0e6424e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:22.718637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ca020-a12f-4842-ada4-b965c0e6424e None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:22.735255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 636/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 16 14:59:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:22.741088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d9c9-8da6-431e-9951-f19d9ba74396 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:22.836704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7d9c9-8da6-431e-9951-f19d9ba74396 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:22.867766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b648466-4e2b-4526-8682-9f4010740ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:22.868398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b648466-4e2b-4526-8682-9f4010740ddc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:22.868675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b648466-4e2b-4526-8682-9f4010740ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:22.868941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b648466-4e2b-4526-8682-9f4010740ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:22.932825 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b648466-4e2b-4526-8682-9f4010740ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:22.934886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b648466-4e2b-4526-8682-9f4010740ddc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:23.026746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 619/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:59:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:59:23.032570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ca020-a12f-4842-ada4-b965c0e6424e None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:23.128627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ca020-a12f-4842-ada4-b965c0e6424e None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:23.160432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966476d8-6550-40e2-a53d-83f3cb70a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:23.161208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966476d8-6550-40e2-a53d-83f3cb70a5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:23.161486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966476d8-6550-40e2-a53d-83f3cb70a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:23.161755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966476d8-6550-40e2-a53d-83f3cb70a5d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:23.171866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966476d8-6550-40e2-a53d-83f3cb70a5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:23.173296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966476d8-6550-40e2-a53d-83f3cb70a5d1 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-966476d8-6550-40e2-a53d-83f3cb70a5d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:23.191615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:23.192705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:23.193646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:23.193646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:23.193646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:23.193646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:23.193646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 637/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:23.198717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b648466-4e2b-4526-8682-9f4010740ddc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:23.292562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b648466-4e2b-4526-8682-9f4010740ddc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:23.324244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272a650-7f6c-4437-93f2-2409d77fa807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:23.324900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272a650-7f6c-4437-93f2-2409d77fa807 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:23.325181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272a650-7f6c-4437-93f2-2409d77fa807 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:23.325452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272a650-7f6c-4437-93f2-2409d77fa807 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:23.326182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272a650-7f6c-4437-93f2-2409d77fa807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:23.326483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272a650-7f6c-4437-93f2-2409d77fa807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:23.327870 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272a650-7f6c-4437-93f2-2409d77fa807 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:23.338483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 620/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:23.344594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966476d8-6550-40e2-a53d-83f3cb70a5d1 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:23.437527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966476d8-6550-40e2-a53d-83f3cb70a5d1 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:23.469359 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dc254-e3d6-4361-aec7-7ab5f3dd349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:23.470156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dc254-e3d6-4361-aec7-7ab5f3dd349f None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:23.470432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dc254-e3d6-4361-aec7-7ab5f3dd349f None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:23.470694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dc254-e3d6-4361-aec7-7ab5f3dd349f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:23.477295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dc254-e3d6-4361-aec7-7ab5f3dd349f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:23.478745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75dc254-e3d6-4361-aec7-7ab5f3dd349f None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-f75dc254-e3d6-4361-aec7-7ab5f3dd349f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:59:23.492484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:23.493532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:23.494972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:59:23.494972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:59:23.494972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:59:23.494972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:59:23.494972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:59:23.494972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:59:23.494972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:23.494972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:23.494972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 638/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:23.499598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272a650-7f6c-4437-93f2-2409d77fa807 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:23.593123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272a650-7f6c-4437-93f2-2409d77fa807 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:23.624560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819a1eb-3715-4648-8fe0-d06f09f93ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:23.625205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819a1eb-3715-4648-8fe0-d06f09f93ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:23.625485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819a1eb-3715-4648-8fe0-d06f09f93ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:23.625758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819a1eb-3715-4648-8fe0-d06f09f93ce9 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:23.626558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819a1eb-3715-4648-8fe0-d06f09f93ce9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:23.626957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819a1eb-3715-4648-8fe0-d06f09f93ce9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:23.628476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819a1eb-3715-4648-8fe0-d06f09f93ce9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:23.640588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 621/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:23.646610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dc254-e3d6-4361-aec7-7ab5f3dd349f None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:23.741439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dc254-e3d6-4361-aec7-7ab5f3dd349f None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:23.773803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f663e-609f-45a5-a54c-2c6fed739d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:23.774483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f663e-609f-45a5-a54c-2c6fed739d3c None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:23.774728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f663e-609f-45a5-a54c-2c6fed739d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:23.774996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f663e-609f-45a5-a54c-2c6fed739d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:23.775807 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f663e-609f-45a5-a54c-2c6fed739d3c None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=6dfdb39ae2804b2191cea53f2a387c3e) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:23.776110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f663e-609f-45a5-a54c-2c6fed739d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:23.777515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f663e-609f-45a5-a54c-2c6fed739d3c None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:23.782731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 639/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:59:23 2022] GET /identity/v3/role_assignments?user.id=6dfdb39ae2804b2191cea53f2a387c3e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=042169a166e14a80beac826291ceaf73 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:25.949147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccae20e-d2d1-4e91-b887-f14ac7073034 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:25.949679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccae20e-d2d1-4e91-b887-f14ac7073034 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:25.949679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccae20e-d2d1-4e91-b887-f14ac7073034 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:25.951606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 622/1261] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:25.956926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bce23-1d9c-4af8-9ca0-6ad38a47e1be None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:25.957322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bce23-1d9c-4af8-9ca0-6ad38a47e1be None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:25.957480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bce23-1d9c-4af8-9ca0-6ad38a47e1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:25.974492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-1b3bce23-1d9c-4af8-9ca0-6ad38a47e1be None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:25.975685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1b3bce23-1d9c-4af8-9ca0-6ad38a47e1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:26.038574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 640/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:26.060492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccae20e-d2d1-4e91-b887-f14ac7073034 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:26.156599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccae20e-d2d1-4e91-b887-f14ac7073034 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:26.188263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fbab8-6405-4b96-871b-dd1946a8c6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:26.189042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fbab8-6405-4b96-871b-dd1946a8c6ca None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:26.189318 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fbab8-6405-4b96-871b-dd1946a8c6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:26.189585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fbab8-6405-4b96-871b-dd1946a8c6ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:26.199121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fbab8-6405-4b96-871b-dd1946a8c6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-463fbab8-6405-4b96-871b-dd1946a8c6ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:59:26.207103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:26.208191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:26.209249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 623/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:26.214315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bce23-1d9c-4af8-9ca0-6ad38a47e1be None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:26.307109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bce23-1d9c-4af8-9ca0-6ad38a47e1be None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:26.339812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ea7b4-7b83-4e31-8788-35423344cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:26.340564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ea7b4-7b83-4e31-8788-35423344cf3b None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:26.341141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ea7b4-7b83-4e31-8788-35423344cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:26.341419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ea7b4-7b83-4e31-8788-35423344cf3b None admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:26.342186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ea7b4-7b83-4e31-8788-35423344cf3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:26.342488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ea7b4-7b83-4e31-8788-35423344cf3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:26.343850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ea7b4-7b83-4e31-8788-35423344cf3b None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:26.351781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 641/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:26.357783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fbab8-6405-4b96-871b-dd1946a8c6ca None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:26.452007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fbab8-6405-4b96-871b-dd1946a8c6ca None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:26.483670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933ca36-039c-418b-9248-251b672c2632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:26.484374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933ca36-039c-418b-9248-251b672c2632 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:26.484655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933ca36-039c-418b-9248-251b672c2632 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:26.484928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933ca36-039c-418b-9248-251b672c2632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:26.495905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933ca36-039c-418b-9248-251b672c2632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:26.497873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933ca36-039c-418b-9248-251b672c2632 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-4933ca36-039c-418b-9248-251b672c2632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:26.514888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:26.515951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:26.517037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:26.517037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:26.517037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:26.517037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:26.517037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 624/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:26.521762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ea7b4-7b83-4e31-8788-35423344cf3b None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:26.613698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ea7b4-7b83-4e31-8788-35423344cf3b None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:26.645946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f7c28-3ed4-42f6-b1cd-bf31d435d103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:26.646626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f7c28-3ed4-42f6-b1cd-bf31d435d103 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:26.646901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f7c28-3ed4-42f6-b1cd-bf31d435d103 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:26.647170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f7c28-3ed4-42f6-b1cd-bf31d435d103 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:26.647922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f7c28-3ed4-42f6-b1cd-bf31d435d103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:26.648222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f7c28-3ed4-42f6-b1cd-bf31d435d103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:26.649574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f7c28-3ed4-42f6-b1cd-bf31d435d103 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:26.660553 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 642/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:59:26.666228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933ca36-039c-418b-9248-251b672c2632 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:26.760568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933ca36-039c-418b-9248-251b672c2632 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:26.791486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22939e97-8899-429c-9869-f77c1cdcd230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:26.792266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22939e97-8899-429c-9869-f77c1cdcd230 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:26.792546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22939e97-8899-429c-9869-f77c1cdcd230 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:26.792819 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22939e97-8899-429c-9869-f77c1cdcd230 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:26.800477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22939e97-8899-429c-9869-f77c1cdcd230 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:26.804317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22939e97-8899-429c-9869-f77c1cdcd230 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-22939e97-8899-429c-9869-f77c1cdcd230 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:59:26.816228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:26.817217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:26.818300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 625/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:26.823109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f7c28-3ed4-42f6-b1cd-bf31d435d103 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:26.920738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f7c28-3ed4-42f6-b1cd-bf31d435d103 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:26.953884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43240bbf-de43-4b60-abac-a1870b78be09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:26.954570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43240bbf-de43-4b60-abac-a1870b78be09 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:26.954851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43240bbf-de43-4b60-abac-a1870b78be09 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:26.955126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43240bbf-de43-4b60-abac-a1870b78be09 None admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:26.955950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43240bbf-de43-4b60-abac-a1870b78be09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:26.956257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43240bbf-de43-4b60-abac-a1870b78be09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:26.957708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43240bbf-de43-4b60-abac-a1870b78be09 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:26.973725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 643/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 16 14:59:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:26.979541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22939e97-8899-429c-9869-f77c1cdcd230 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:27.074516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22939e97-8899-429c-9869-f77c1cdcd230 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:27.107464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf1d0-cfc0-443c-9b01-5cf165342abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:27.108236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf1d0-cfc0-443c-9b01-5cf165342abb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:27.108515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf1d0-cfc0-443c-9b01-5cf165342abb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:27.108783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddf1d0-cfc0-443c-9b01-5cf165342abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:27.118713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddf1d0-cfc0-443c-9b01-5cf165342abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:27.120145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddf1d0-cfc0-443c-9b01-5cf165342abb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2fddf1d0-cfc0-443c-9b01-5cf165342abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:27.136339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:27.137400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:27.138828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:27.138828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:27.138828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:27.138828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:27.138828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 626/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:27.143153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43240bbf-de43-4b60-abac-a1870b78be09 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:27.237437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43240bbf-de43-4b60-abac-a1870b78be09 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:27.269466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0ab0c-1402-4901-8295-da69a7466e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:27.270274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0ab0c-1402-4901-8295-da69a7466e20 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:27.270562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0ab0c-1402-4901-8295-da69a7466e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:27.270835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0ab0c-1402-4901-8295-da69a7466e20 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:27.271548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0ab0c-1402-4901-8295-da69a7466e20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:27.271854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0ab0c-1402-4901-8295-da69a7466e20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:27.273262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0ab0c-1402-4901-8295-da69a7466e20 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:27.284417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 644/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:27.290071 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf1d0-cfc0-443c-9b01-5cf165342abb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:27.386421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddf1d0-cfc0-443c-9b01-5cf165342abb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:27.419191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2217-63e2-4453-a17c-e0b1493a8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:27.419976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2217-63e2-4453-a17c-e0b1493a8f23 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:27.420256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2217-63e2-4453-a17c-e0b1493a8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:27.420528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f2217-63e2-4453-a17c-e0b1493a8f23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:27.427249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f2217-63e2-4453-a17c-e0b1493a8f23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:27.428676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f2217-63e2-4453-a17c-e0b1493a8f23 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-a61f2217-63e2-4453-a17c-e0b1493a8f23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:59:27.442475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:27.443472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:27.444363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:59:27.444363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:59:27.444363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:59:27.444363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:59:27.444363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:59:27.444363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:59:27.444363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:27.444363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:27.444363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 627/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:27.449471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0ab0c-1402-4901-8295-da69a7466e20 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:27.545396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0ab0c-1402-4901-8295-da69a7466e20 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:27.576336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaed821-2d95-491f-8aa1-56cf7dcb1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:27.576980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed821-2d95-491f-8aa1-56cf7dcb1b6d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:27.577256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed821-2d95-491f-8aa1-56cf7dcb1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:27.577529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed821-2d95-491f-8aa1-56cf7dcb1b6d None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:27.578331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaed821-2d95-491f-8aa1-56cf7dcb1b6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:27.578637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaed821-2d95-491f-8aa1-56cf7dcb1b6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:27.580051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaed821-2d95-491f-8aa1-56cf7dcb1b6d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:27.591887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 645/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:27.597967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2217-63e2-4453-a17c-e0b1493a8f23 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:27.690687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f2217-63e2-4453-a17c-e0b1493a8f23 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:27.722677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0434096-74ae-48d7-b7d4-08be5f1e79b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:27.723533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434096-74ae-48d7-b7d4-08be5f1e79b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:27.723808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434096-74ae-48d7-b7d4-08be5f1e79b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:27.724078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434096-74ae-48d7-b7d4-08be5f1e79b8 None admin] PATH_INFO: `/v3/projects/f6f844054076425cbd50972e6c4a625f/users/6dfdb39ae2804b2191cea53f2a387c3e/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:27.726264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0434096-74ae-48d7-b7d4-08be5f1e79b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6f844054076425cbd50972e6c4a625f, user_id=6dfdb39ae2804b2191cea53f2a387c3e, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:27.727677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0434096-74ae-48d7-b7d4-08be5f1e79b8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:27.839812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 628/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Mon May 16 14:59:27 2022] PUT /identity/v3/projects/f6f844054076425cbd50972e6c4a625f/users/6dfdb39ae2804b2191cea53f2a387c3e/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 14:59:30.034644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67237c-b83c-48e5-b2c0-a89930955d49 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:30.035228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67237c-b83c-48e5-b2c0-a89930955d49 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:30.035228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67237c-b83c-48e5-b2c0-a89930955d49 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:30.036606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 646/1274] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:30.041758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6b530-3db9-4251-8a87-22b1a78a03b7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:30.042174 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6b530-3db9-4251-8a87-22b1a78a03b7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:30.042345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6b530-3db9-4251-8a87-22b1a78a03b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:30.059712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-53f6b530-3db9-4251-8a87-22b1a78a03b7 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:30.060894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-53f6b530-3db9-4251-8a87-22b1a78a03b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:30.127854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 629/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:30.151089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67237c-b83c-48e5-b2c0-a89930955d49 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:30.248280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67237c-b83c-48e5-b2c0-a89930955d49 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:30.281110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70979-3921-48ee-a8be-379a70d7cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:30.281887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70979-3921-48ee-a8be-379a70d7cb12 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:30.282201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70979-3921-48ee-a8be-379a70d7cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:30.282473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70979-3921-48ee-a8be-379a70d7cb12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:30.292460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e70979-3921-48ee-a8be-379a70d7cb12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-10e70979-3921-48ee-a8be-379a70d7cb12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 14:59:30.300003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:30.301156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:30.302613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 647/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Mon May 16 14:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:59:30.307295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6b530-3db9-4251-8a87-22b1a78a03b7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:30.402355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6b530-3db9-4251-8a87-22b1a78a03b7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:30.435440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba9e0-18f7-45c2-958e-e20f12cccca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:30.436085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba9e0-18f7-45c2-958e-e20f12cccca6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:30.436357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba9e0-18f7-45c2-958e-e20f12cccca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:30.436735 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba9e0-18f7-45c2-958e-e20f12cccca6 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:30.437490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba9e0-18f7-45c2-958e-e20f12cccca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:30.437784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba9e0-18f7-45c2-958e-e20f12cccca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:30.439386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba9e0-18f7-45c2-958e-e20f12cccca6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:30.447174 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 630/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Mon May 16 14:59:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:30.453100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70979-3921-48ee-a8be-379a70d7cb12 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:30.546726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70979-3921-48ee-a8be-379a70d7cb12 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:30.579132 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223eb5e4-0890-470f-a2bd-208a916a886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:30.579913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eb5e4-0890-470f-a2bd-208a916a886d None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:30.580196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eb5e4-0890-470f-a2bd-208a916a886d None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:30.580469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223eb5e4-0890-470f-a2bd-208a916a886d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:30.591287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223eb5e4-0890-470f-a2bd-208a916a886d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:30.592797 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223eb5e4-0890-470f-a2bd-208a916a886d None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-223eb5e4-0890-470f-a2bd-208a916a886d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:30.610175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:30.611238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:30.612279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:30.612279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:30.612279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:30.612279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:30.612279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 648/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:30.617089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba9e0-18f7-45c2-958e-e20f12cccca6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:30.711800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba9e0-18f7-45c2-958e-e20f12cccca6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:30.743338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afeec79-fad8-483c-b3e3-4d13f925e145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:30.748256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afeec79-fad8-483c-b3e3-4d13f925e145 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:30.748256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afeec79-fad8-483c-b3e3-4d13f925e145 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:30.748256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afeec79-fad8-483c-b3e3-4d13f925e145 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:30.748256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afeec79-fad8-483c-b3e3-4d13f925e145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:30.748256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afeec79-fad8-483c-b3e3-4d13f925e145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:30.748256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afeec79-fad8-483c-b3e3-4d13f925e145 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:30.758800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 631/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:30.764436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223eb5e4-0890-470f-a2bd-208a916a886d None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:30.862007 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223eb5e4-0890-470f-a2bd-208a916a886d None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:30.893689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611127-ecda-40b1-a2e7-edd0df7adfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:30.894511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611127-ecda-40b1-a2e7-edd0df7adfab None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:30.894796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611127-ecda-40b1-a2e7-edd0df7adfab None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:30.895068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611127-ecda-40b1-a2e7-edd0df7adfab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:30.902265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89611127-ecda-40b1-a2e7-edd0df7adfab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:30.904186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89611127-ecda-40b1-a2e7-edd0df7adfab None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-89611127-ecda-40b1-a2e7-edd0df7adfab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 14:59:30.917894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:30.923490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:30.924721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 649/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:30.925549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afeec79-fad8-483c-b3e3-4d13f925e145 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:31.020543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afeec79-fad8-483c-b3e3-4d13f925e145 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:31.053462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d491864-7c88-40d6-995e-cb619180abec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:31.054147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d491864-7c88-40d6-995e-cb619180abec None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:31.054424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d491864-7c88-40d6-995e-cb619180abec None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:31.054693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d491864-7c88-40d6-995e-cb619180abec None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:31.055515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d491864-7c88-40d6-995e-cb619180abec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:31.055845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d491864-7c88-40d6-995e-cb619180abec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:31.057256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d491864-7c88-40d6-995e-cb619180abec None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:31.073301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 632/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Mon May 16 14:59:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 14:59:31.079360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611127-ecda-40b1-a2e7-edd0df7adfab None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:31.173188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611127-ecda-40b1-a2e7-edd0df7adfab None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:31.204648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cd965-825f-491e-b665-a8267c5e65ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:31.205280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cd965-825f-491e-b665-a8267c5e65ca None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:31.205558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cd965-825f-491e-b665-a8267c5e65ca None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:31.205827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cd965-825f-491e-b665-a8267c5e65ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:31.272220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cd965-825f-491e-b665-a8267c5e65ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:31.273663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cd965-825f-491e-b665-a8267c5e65ca None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:31.365180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 650/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Mon May 16 14:59:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 14:59:31.371066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d491864-7c88-40d6-995e-cb619180abec None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:31.464030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d491864-7c88-40d6-995e-cb619180abec None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:31.496299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e5466-4c9e-41ab-a129-9610509edcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:31.497077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e5466-4c9e-41ab-a129-9610509edcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:31.497907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e5466-4c9e-41ab-a129-9610509edcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:31.498227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e5466-4c9e-41ab-a129-9610509edcb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:31.507843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e5466-4c9e-41ab-a129-9610509edcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:31.509270 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e5466-4c9e-41ab-a129-9610509edcb6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-047e5466-4c9e-41ab-a129-9610509edcb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 14:59:31.526803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:31.527866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:31.529337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 14:59:31.529337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 14:59:31.529337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 14:59:31.529337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:31.529337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 633/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 14:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 14:59:31.534268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cd965-825f-491e-b665-a8267c5e65ca None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:31.627255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cd965-825f-491e-b665-a8267c5e65ca None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:31.659233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb24b6-d047-44af-8f3a-5e195cf4b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:31.659906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb24b6-d047-44af-8f3a-5e195cf4b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:31.660185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb24b6-d047-44af-8f3a-5e195cf4b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:31.660455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb24b6-d047-44af-8f3a-5e195cf4b6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:31.661168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb24b6-d047-44af-8f3a-5e195cf4b6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:31.661478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb24b6-d047-44af-8f3a-5e195cf4b6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:31.662897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb24b6-d047-44af-8f3a-5e195cf4b6f8 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:31.674004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 651/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Mon May 16 14:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:31.679656 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e5466-4c9e-41ab-a129-9610509edcb6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:31.773397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e5466-4c9e-41ab-a129-9610509edcb6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:31.806911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256f923-6fbe-40c3-aed4-d3109f2f939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:31.807685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256f923-6fbe-40c3-aed4-d3109f2f939f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:31.807961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256f923-6fbe-40c3-aed4-d3109f2f939f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:31.808229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256f923-6fbe-40c3-aed4-d3109f2f939f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:31.814879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256f923-6fbe-40c3-aed4-d3109f2f939f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:31.816385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256f923-6fbe-40c3-aed4-d3109f2f939f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-3256f923-6fbe-40c3-aed4-d3109f2f939f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 14:59:31.830526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:31.831492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:31.832530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 14:59:31.832530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 14:59:31.832530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 14:59:31.832530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 14:59:31.832530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 14:59:31.832530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 14:59:31.832530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 14:59:31.832530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application May 16 14:59:31.832530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 634/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Mon May 16 14:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:31.837609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb24b6-d047-44af-8f3a-5e195cf4b6f8 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:31.939275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb24b6-d047-44af-8f3a-5e195cf4b6f8 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:31.970917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2999441-23b0-4a42-a0e0-291b38835ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:31.971618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999441-23b0-4a42-a0e0-291b38835ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:31.971898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999441-23b0-4a42-a0e0-291b38835ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:31.972169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2999441-23b0-4a42-a0e0-291b38835ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:31.972989 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2999441-23b0-4a42-a0e0-291b38835ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:31.973296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2999441-23b0-4a42-a0e0-291b38835ad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:31.975011 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2999441-23b0-4a42-a0e0-291b38835ad3 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:31.987071 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 652/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Mon May 16 14:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:31.993133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256f923-6fbe-40c3-aed4-d3109f2f939f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:32.090749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256f923-6fbe-40c3-aed4-d3109f2f939f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:32.121897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625b435-df79-4dff-8072-735e2bed26fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:32.123190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625b435-df79-4dff-8072-735e2bed26fa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:32.123468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625b435-df79-4dff-8072-735e2bed26fa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:32.123734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625b435-df79-4dff-8072-735e2bed26fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:32.124534 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625b435-df79-4dff-8072-735e2bed26fa None admin] RBAC: Adding query filter params (role.id=042169a166e14a80beac826291ceaf73, scope.project.id=f6f844054076425cbd50972e6c4a625f, user.id=6dfdb39ae2804b2191cea53f2a387c3e) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:32.124837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625b435-df79-4dff-8072-735e2bed26fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:32.126264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625b435-df79-4dff-8072-735e2bed26fa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:32.131917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 635/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Mon May 16 14:59:31 2022] GET /identity/v3/role_assignments?user.id=6dfdb39ae2804b2191cea53f2a387c3e&scope.project.id=f6f844054076425cbd50972e6c4a625f&role.id=042169a166e14a80beac826291ceaf73 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:34.367559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf17d5-767e-4367-9a93-9f854ef9ac19 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:34.368099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf17d5-767e-4367-9a93-9f854ef9ac19 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:34.368099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf17d5-767e-4367-9a93-9f854ef9ac19 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:34.369566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 653/1288] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:34.374890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c87c3-e10d-417e-abf7-cd05d208bc6a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:34.375280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c87c3-e10d-417e-abf7-cd05d208bc6a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:34.375478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c87c3-e10d-417e-abf7-cd05d208bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:34.392005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-020c87c3-e10d-417e-abf7-cd05d208bc6a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:34.393169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-020c87c3-e10d-417e-abf7-cd05d208bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:34.454994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 636/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:34.477818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf17d5-767e-4367-9a93-9f854ef9ac19 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:34.571873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf17d5-767e-4367-9a93-9f854ef9ac19 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:34.603364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7bc1-5a73-4819-840c-5d007b02c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:34.604143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7bc1-5a73-4819-840c-5d007b02c9fa None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:34.604441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7bc1-5a73-4819-840c-5d007b02c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:34.604689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7bc1-5a73-4819-840c-5d007b02c9fa None admin] PATH_INFO: `/v3/services/placement` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:34.605341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb7bc1-5a73-4819-840c-5d007b02c9fa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:34.606726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb7bc1-5a73-4819-840c-5d007b02c9fa None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-4dbb7bc1-5a73-4819-840c-5d007b02c9fa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:34.618086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:34.619186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:34.620203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 654/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:59:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:34.625974 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c87c3-e10d-417e-abf7-cd05d208bc6a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:34.718020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c87c3-e10d-417e-abf7-cd05d208bc6a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:34.749671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5fa90-8e78-4115-9d18-bae691d5ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:34.750362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5fa90-8e78-4115-9d18-bae691d5ac06 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:34.750642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5fa90-8e78-4115-9d18-bae691d5ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:34.750910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5fa90-8e78-4115-9d18-bae691d5ac06 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:34.751628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5fa90-8e78-4115-9d18-bae691d5ac06 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:34.751929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5fa90-8e78-4115-9d18-bae691d5ac06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:34.753296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5fa90-8e78-4115-9d18-bae691d5ac06 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:34.758030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 637/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Mon May 16 14:59:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:34.764511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7bc1-5a73-4819-840c-5d007b02c9fa None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:34.858424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7bc1-5a73-4819-840c-5d007b02c9fa None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:34.890291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c085e-316e-440d-bd44-e7e1a5745ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:34.890880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c085e-316e-440d-bd44-e7e1a5745ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:34.891155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c085e-316e-440d-bd44-e7e1a5745ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:34.891421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c085e-316e-440d-bd44-e7e1a5745ab0 None admin] PATH_INFO: `/v3/services` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:34.892111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c085e-316e-440d-bd44-e7e1a5745ab0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:34.892408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c085e-316e-440d-bd44-e7e1a5745ab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:34.893789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c085e-316e-440d-bd44-e7e1a5745ab0 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:34.898031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 655/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Mon May 16 14:59:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:37.077731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1a70-368c-41b8-9f35-d99c5d8238db None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:37.078292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1a70-368c-41b8-9f35-d99c5d8238db None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:37.078292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1a70-368c-41b8-9f35-d99c5d8238db None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:37.080105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 638/1293] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:37.085069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92b694-a6ce-4f0b-b1ea-6d77e73dffab None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:37.085451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92b694-a6ce-4f0b-b1ea-6d77e73dffab None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:37.085625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92b694-a6ce-4f0b-b1ea-6d77e73dffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:37.101901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8b92b694-a6ce-4f0b-b1ea-6d77e73dffab None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:37.103099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8b92b694-a6ce-4f0b-b1ea-6d77e73dffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:37.165058 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 656/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:37.188184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1a70-368c-41b8-9f35-d99c5d8238db None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:37.282394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1a70-368c-41b8-9f35-d99c5d8238db None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:37.315697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d0a51-dc76-47ef-ac55-40cdb87af708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:37.316345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d0a51-dc76-47ef-ac55-40cdb87af708 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:37.316622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d0a51-dc76-47ef-ac55-40cdb87af708 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:37.316891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d0a51-dc76-47ef-ac55-40cdb87af708 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:37.317597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d0a51-dc76-47ef-ac55-40cdb87af708 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:37.318981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d0a51-dc76-47ef-ac55-40cdb87af708 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:37.411732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 639/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Mon May 16 14:59:37 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 14:59:39.619314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809e15-ea2b-4ece-a759-299ebf0f24d0 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:39.619871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809e15-ea2b-4ece-a759-299ebf0f24d0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:39.619871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809e15-ea2b-4ece-a759-299ebf0f24d0 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:39.621261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 657/1296] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:39.626733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f827-27dc-47b5-b23c-3eeb1df32176 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:39.631141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f827-27dc-47b5-b23c-3eeb1df32176 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:39.631141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f827-27dc-47b5-b23c-3eeb1df32176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:39.643956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9a77f827-27dc-47b5-b23c-3eeb1df32176 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:39.645188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9a77f827-27dc-47b5-b23c-3eeb1df32176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:39.714206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 640/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:39.737755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809e15-ea2b-4ece-a759-299ebf0f24d0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:39.832178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809e15-ea2b-4ece-a759-299ebf0f24d0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:39.864870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f804b-9083-43c4-8cc0-3baf3e4afebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:39.865651 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f804b-9083-43c4-8cc0-3baf3e4afebc None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:39.865927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f804b-9083-43c4-8cc0-3baf3e4afebc None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:39.866230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f804b-9083-43c4-8cc0-3baf3e4afebc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:39.866876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f804b-9083-43c4-8cc0-3baf3e4afebc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:39.868225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f804b-9083-43c4-8cc0-3baf3e4afebc None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-002f804b-9083-43c4-8cc0-3baf3e4afebc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:39.879561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:39.880528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:39.881488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 658/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:59:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:39.886905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f827-27dc-47b5-b23c-3eeb1df32176 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:39.979749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f827-27dc-47b5-b23c-3eeb1df32176 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:40.012756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052839be-65a4-43c7-9d1e-aacbc661304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:40.013444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052839be-65a4-43c7-9d1e-aacbc661304e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:40.013720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052839be-65a4-43c7-9d1e-aacbc661304e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:40.013988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052839be-65a4-43c7-9d1e-aacbc661304e None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:40.014717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052839be-65a4-43c7-9d1e-aacbc661304e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:40.015015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052839be-65a4-43c7-9d1e-aacbc661304e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:40.016472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052839be-65a4-43c7-9d1e-aacbc661304e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:40.021387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 641/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Mon May 16 14:59:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:40.027201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f804b-9083-43c4-8cc0-3baf3e4afebc None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:40.120437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f804b-9083-43c4-8cc0-3baf3e4afebc None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:40.151482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e6dde-7ae4-430a-ad39-6ee31f4fd9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:40.152062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e6dde-7ae4-430a-ad39-6ee31f4fd9fa None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:40.152339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e6dde-7ae4-430a-ad39-6ee31f4fd9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:40.152605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e6dde-7ae4-430a-ad39-6ee31f4fd9fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:40.153374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e6dde-7ae4-430a-ad39-6ee31f4fd9fa None admin] RBAC: Adding query filter params (interface=public, service_id=b66cb330240e4816b70e971c362cc17a, region_id=RegionOne) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:40.153677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e6dde-7ae4-430a-ad39-6ee31f4fd9fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:40.155654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e6dde-7ae4-430a-ad39-6ee31f4fd9fa None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:40.160395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 659/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Mon May 16 14:59:40 2022] GET /identity/v3/endpoints?service_id=b66cb330240e4816b70e971c362cc17a&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:40.165907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052839be-65a4-43c7-9d1e-aacbc661304e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:40.259809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052839be-65a4-43c7-9d1e-aacbc661304e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:40.292598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2aa66-cd06-485b-8f3d-76352ed7a0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:40.293249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2aa66-cd06-485b-8f3d-76352ed7a0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:40.293524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2aa66-cd06-485b-8f3d-76352ed7a0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:40.293793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2aa66-cd06-485b-8f3d-76352ed7a0c8 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:40.294493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2aa66-cd06-485b-8f3d-76352ed7a0c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:40.295847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2aa66-cd06-485b-8f3d-76352ed7a0c8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:40.302554 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 642/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Mon May 16 14:59:40 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 14:59:42.504560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4c82-9e02-48ad-bfd8-af4c5ea8ddb1 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:42.505089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4c82-9e02-48ad-bfd8-af4c5ea8ddb1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:42.505089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c4c82-9e02-48ad-bfd8-af4c5ea8ddb1 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:42.506443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 660/1302] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 14:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 14:59:42.511779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2fb56-950e-47eb-814a-bc56ed0e971a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:42.514109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2fb56-950e-47eb-814a-bc56ed0e971a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:42.514109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2fb56-950e-47eb-814a-bc56ed0e971a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:42.528764 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8ba2fb56-950e-47eb-814a-bc56ed0e971a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 14:59:42.529931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8ba2fb56-950e-47eb-814a-bc56ed0e971a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 14:59:42.593621 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 643/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 14:59:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 14:59:42.616676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c4c82-9e02-48ad-bfd8-af4c5ea8ddb1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:42.712465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c4c82-9e02-48ad-bfd8-af4c5ea8ddb1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:42.743888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeebd3-7c99-4673-990c-14c030630023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:42.744655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeebd3-7c99-4673-990c-14c030630023 None admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:42.744929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeebd3-7c99-4673-990c-14c030630023 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:42.745197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeebd3-7c99-4673-990c-14c030630023 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:42.745840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeebd3-7c99-4673-990c-14c030630023 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:42.747348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeebd3-7c99-4673-990c-14c030630023 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application [None req-ddaeebd3-7c99-4673-990c-14c030630023 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 14:59:42.759133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 14:59:42.765085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.get_or_create( May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application with Lock( May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self._enter() May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application return self.creator() May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application created_value = creator( May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: ERROR keystone.server.flask.application May 16 14:59:42.769140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 661/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Mon May 16 14:59:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 14:59:42.769937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2fb56-950e-47eb-814a-bc56ed0e971a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:42.859696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2fb56-950e-47eb-814a-bc56ed0e971a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:42.891457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf70c3-1027-4dee-8c38-aeef00640f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:42.892111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf70c3-1027-4dee-8c38-aeef00640f1d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:42.892391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf70c3-1027-4dee-8c38-aeef00640f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:42.892666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf70c3-1027-4dee-8c38-aeef00640f1d None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:42.893361 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf70c3-1027-4dee-8c38-aeef00640f1d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 14:59:42.893668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf70c3-1027-4dee-8c38-aeef00640f1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:42.895067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf70c3-1027-4dee-8c38-aeef00640f1d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:42.899982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 644/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Mon May 16 14:59:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 14:59:42.906283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeebd3-7c99-4673-990c-14c030630023 None admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 14:59:43.000985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeebd3-7c99-4673-990c-14c030630023 None admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 14:59:43.032929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdc579-297d-429d-9e28-3e813ea63030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 14:59:43.033512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc579-297d-429d-9e28-3e813ea63030 None admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 14:59:43.033791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc579-297d-429d-9e28-3e813ea63030 None admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 14:59:43.034080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc579-297d-429d-9e28-3e813ea63030 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 14:59:43.034845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc579-297d-429d-9e28-3e813ea63030 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 14:59:43.036209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc579-297d-429d-9e28-3e813ea63030 None admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 14:59:43.109763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 662/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Mon May 16 14:59:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:05:59.627299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b599c4-1c06-4d9b-b8e5-c8d9a68e8a64 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:59.627877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b599c4-1c06-4d9b-b8e5-c8d9a68e8a64 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:59.627877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b599c4-1c06-4d9b-b8e5-c8d9a68e8a64 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:59.629223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 645/1307] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:59.634453 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25c93c-dbb9-4df5-a8b3-54c6c61bc9bf None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:59.634864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25c93c-dbb9-4df5-a8b3-54c6c61bc9bf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:59.635011 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25c93c-dbb9-4df5-a8b3-54c6c61bc9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:59.704360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9a25c93c-dbb9-4df5-a8b3-54c6c61bc9bf None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:05:59.706204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9a25c93c-dbb9-4df5-a8b3-54c6c61bc9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:05:59.834360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 663/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:05:59.890956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbf53e-d3bd-4be5-816c-8d0dd981a670 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:59.891248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbf53e-d3bd-4be5-816c-8d0dd981a670 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:59.891558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbf53e-d3bd-4be5-816c-8d0dd981a670 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:05:59.893222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 646/1309] 10.222.0.44 () {54 vars in 964 bytes} [Mon May 16 15:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:05:59.901007 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782ab6-3446-4e80-893c-a0416105cdce None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:05:59.901453 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782ab6-3446-4e80-893c-a0416105cdce None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:05:59.901965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782ab6-3446-4e80-893c-a0416105cdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:00.000018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-89782ab6-3446-4e80-893c-a0416105cdce None None] MFA Rules not processed for user `aec8440b7bd84c2b9ce583a01adabf90`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:00.001270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-89782ab6-3446-4e80-893c-a0416105cdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:00.084005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 664/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Mon May 16 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:00.093410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbf53e-d3bd-4be5-816c-8d0dd981a670 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:00.095342 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-83cbf53e-d3bd-4be5-816c-8d0dd981a670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:00.211401 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbf53e-d3bd-4be5-816c-8d0dd981a670 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:00.285609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21352a-a299-46e9-be83-5545b0a08dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:00.286298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21352a-a299-46e9-be83-5545b0a08dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:00.286569 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21352a-a299-46e9-be83-5545b0a08dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:00.286834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21352a-a299-46e9-be83-5545b0a08dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:00.288437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4e21352a-a299-46e9-be83-5545b0a08dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:00.393852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21352a-a299-46e9-be83-5545b0a08dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:00.395232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21352a-a299-46e9-be83-5545b0a08dd5 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:00.413536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 647/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:02.926179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44264-29d9-476b-9177-e97035674159 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:02.927035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44264-29d9-476b-9177-e97035674159 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:02.927471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc44264-29d9-476b-9177-e97035674159 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:02.929046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 665/1312] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:02.934301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab2d60-c0ce-4f48-b0bd-4b84bb6c1eba None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:02.934711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab2d60-c0ce-4f48-b0bd-4b84bb6c1eba None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:02.934858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab2d60-c0ce-4f48-b0bd-4b84bb6c1eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:03.019553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7cab2d60-c0ce-4f48-b0bd-4b84bb6c1eba None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:03.021002 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7cab2d60-c0ce-4f48-b0bd-4b84bb6c1eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:03.116433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 648/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:03.153820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc44264-29d9-476b-9177-e97035674159 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:03.155966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-cdc44264-29d9-476b-9177-e97035674159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:03.266842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc44264-29d9-476b-9177-e97035674159 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:03.348672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997178f4-cc38-41e5-9e50-60d826b12769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:03.349423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997178f4-cc38-41e5-9e50-60d826b12769 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:03.349703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997178f4-cc38-41e5-9e50-60d826b12769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:03.349978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997178f4-cc38-41e5-9e50-60d826b12769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:03.351699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-997178f4-cc38-41e5-9e50-60d826b12769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:03.481755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997178f4-cc38-41e5-9e50-60d826b12769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:03.484035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997178f4-cc38-41e5-9e50-60d826b12769 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:03.505026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 666/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:06.331217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35a575-4f9f-4558-b997-498be2d5eb6b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:06.331773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35a575-4f9f-4558-b997-498be2d5eb6b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:06.331864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35a575-4f9f-4558-b997-498be2d5eb6b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:06.333236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 649/1315] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:06.338454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a27ea8-4824-4a6f-83df-a4f588327850 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:06.338868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a27ea8-4824-4a6f-83df-a4f588327850 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:06.339004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a27ea8-4824-4a6f-83df-a4f588327850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:06.400902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-01a27ea8-4824-4a6f-83df-a4f588327850 None None] MFA Rules not processed for user `d4261f09bd3e4098acde3ccdf5841591`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:06.402118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-01a27ea8-4824-4a6f-83df-a4f588327850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:06.494457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 667/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:06.533931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35a575-4f9f-4558-b997-498be2d5eb6b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:06.535505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7e35a575-4f9f-4558-b997-498be2d5eb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:06.637139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35a575-4f9f-4558-b997-498be2d5eb6b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:06.705004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316004b-f45d-4e1f-8917-c26dca92e048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:06.705641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316004b-f45d-4e1f-8917-c26dca92e048 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:06.705917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316004b-f45d-4e1f-8917-c26dca92e048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:06.706218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316004b-f45d-4e1f-8917-c26dca92e048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:06.707820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1316004b-f45d-4e1f-8917-c26dca92e048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:06.809610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316004b-f45d-4e1f-8917-c26dca92e048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:06.811081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316004b-f45d-4e1f-8917-c26dca92e048 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:06.827736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 650/1317] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:09.883088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86d39-4e70-434f-8824-87e2023a884f None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:09.883684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86d39-4e70-434f-8824-87e2023a884f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:09.883684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca86d39-4e70-434f-8824-87e2023a884f None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:09.884998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 668/1318] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:09.890303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1a751-686b-4cb0-b1b2-f90aefb30585 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:09.890742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1a751-686b-4cb0-b1b2-f90aefb30585 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:09.890848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1a751-686b-4cb0-b1b2-f90aefb30585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:09.951997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-79f1a751-686b-4cb0-b1b2-f90aefb30585 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:09.953173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-79f1a751-686b-4cb0-b1b2-f90aefb30585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:10.045160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 651/1319] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:10.099412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e402bee-f823-4b5b-8c68-2abb68be564c None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:10.099703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e402bee-f823-4b5b-8c68-2abb68be564c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:10.099982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e402bee-f823-4b5b-8c68-2abb68be564c None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:10.101366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 669/1320] 10.222.0.44 () {54 vars in 964 bytes} [Mon May 16 15:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:10.108089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cda35-0e63-4771-90c7-f025dbe73d19 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:10.108382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cda35-0e63-4771-90c7-f025dbe73d19 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:10.108662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cda35-0e63-4771-90c7-f025dbe73d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:10.179321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b93cda35-0e63-4771-90c7-f025dbe73d19 None None] MFA Rules not processed for user `aec8440b7bd84c2b9ce583a01adabf90`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:10.180450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b93cda35-0e63-4771-90c7-f025dbe73d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:10.252797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 652/1321] 10.222.0.44 () {58 vars in 1061 bytes} [Mon May 16 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:06:10.261928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e402bee-f823-4b5b-8c68-2abb68be564c None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:10.263975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1e402bee-f823-4b5b-8c68-2abb68be564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:10.364741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e402bee-f823-4b5b-8c68-2abb68be564c None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:10.433892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb0beb-6714-4b09-ac63-552430f11de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:10.434499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb0beb-6714-4b09-ac63-552430f11de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:10.435296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb0beb-6714-4b09-ac63-552430f11de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:10.435570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb0beb-6714-4b09-ac63-552430f11de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:10.437263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-99bb0beb-6714-4b09-ac63-552430f11de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:10.539609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb0beb-6714-4b09-ac63-552430f11de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:10.541033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb0beb-6714-4b09-ac63-552430f11de3 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:10.558085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 670/1322] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:06:14.170193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325de64-dcea-4933-a969-e6139683a82f None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:14.171876 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325de64-dcea-4933-a969-e6139683a82f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:14.171876 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325de64-dcea-4933-a969-e6139683a82f None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:14.172303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 653/1323] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:14.177533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcdb9c-f022-4c8c-85ba-ed27d4d453ff None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:14.177951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcdb9c-f022-4c8c-85ba-ed27d4d453ff None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:14.178154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcdb9c-f022-4c8c-85ba-ed27d4d453ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:14.240479 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-44bcdb9c-f022-4c8c-85ba-ed27d4d453ff None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:14.241645 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-44bcdb9c-f022-4c8c-85ba-ed27d4d453ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:14.332986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 671/1324] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:14.367937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325de64-dcea-4933-a969-e6139683a82f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:14.369440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1325de64-dcea-4933-a969-e6139683a82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:14.472191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325de64-dcea-4933-a969-e6139683a82f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:14.542933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2230695-df57-4caa-99a9-15eacf2e8b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:14.544075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230695-df57-4caa-99a9-15eacf2e8b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:14.544355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230695-df57-4caa-99a9-15eacf2e8b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:14.544632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230695-df57-4caa-99a9-15eacf2e8b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:14.546295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c2230695-df57-4caa-99a9-15eacf2e8b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:14.650214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2230695-df57-4caa-99a9-15eacf2e8b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:14.651573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2230695-df57-4caa-99a9-15eacf2e8b29 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:14.669603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 654/1325] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:16.940671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea16f-92dd-48bc-a9b6-4f95b4ddc56e None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:16.941299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea16f-92dd-48bc-a9b6-4f95b4ddc56e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:16.941299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ea16f-92dd-48bc-a9b6-4f95b4ddc56e None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:16.942864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 672/1326] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:16.948548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f575ae-12a6-44fb-9f92-eeb1af68816a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:16.949066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f575ae-12a6-44fb-9f92-eeb1af68816a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:16.949232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f575ae-12a6-44fb-9f92-eeb1af68816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:17.011817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-30f575ae-12a6-44fb-9f92-eeb1af68816a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:17.013015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-30f575ae-12a6-44fb-9f92-eeb1af68816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:17.106140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 655/1327] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:17.141185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ea16f-92dd-48bc-a9b6-4f95b4ddc56e None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:17.142714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d16ea16f-92dd-48bc-a9b6-4f95b4ddc56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:17.242008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ea16f-92dd-48bc-a9b6-4f95b4ddc56e None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:17.312349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d12e1-dd63-4d4c-a5b3-62b0d59c6a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:17.312994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d12e1-dd63-4d4c-a5b3-62b0d59c6a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:17.313276 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d12e1-dd63-4d4c-a5b3-62b0d59c6a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:17.313550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d12e1-dd63-4d4c-a5b3-62b0d59c6a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:17.315225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e57d12e1-dd63-4d4c-a5b3-62b0d59c6a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:17.420891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d12e1-dd63-4d4c-a5b3-62b0d59c6a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:17.422420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d12e1-dd63-4d4c-a5b3-62b0d59c6a2f service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:17.439741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 673/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:19.699808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccafb7-bc06-4035-af7f-740dcd7074e5 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:19.700345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccafb7-bc06-4035-af7f-740dcd7074e5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:19.700345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccafb7-bc06-4035-af7f-740dcd7074e5 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:19.702041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 656/1329] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:19.707449 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c18f-dafd-43ed-bc97-4cd64fadc5ff None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:19.707849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c18f-dafd-43ed-bc97-4cd64fadc5ff None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:19.707991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c18f-dafd-43ed-bc97-4cd64fadc5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:19.769563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9372c18f-dafd-43ed-bc97-4cd64fadc5ff None None] MFA Rules not processed for user `d4261f09bd3e4098acde3ccdf5841591`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:19.770770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9372c18f-dafd-43ed-bc97-4cd64fadc5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:19.860328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 674/1330] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:19.897551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccafb7-bc06-4035-af7f-740dcd7074e5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:19.899076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-97ccafb7-bc06-4035-af7f-740dcd7074e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:20.001926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccafb7-bc06-4035-af7f-740dcd7074e5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:20.071912 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc747a59-6b9b-4bd8-9677-9a9a72883797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:20.072562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747a59-6b9b-4bd8-9677-9a9a72883797 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:20.072844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747a59-6b9b-4bd8-9677-9a9a72883797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:20.073157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747a59-6b9b-4bd8-9677-9a9a72883797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:20.074855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cc747a59-6b9b-4bd8-9677-9a9a72883797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:20.179285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc747a59-6b9b-4bd8-9677-9a9a72883797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:20.180711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc747a59-6b9b-4bd8-9677-9a9a72883797 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:20.197968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 657/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:22.881155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f86b-5e2c-4e89-be9c-d53e83e65816 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:22.881732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f86b-5e2c-4e89-be9c-d53e83e65816 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:22.881732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f86b-5e2c-4e89-be9c-d53e83e65816 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:22.883105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 675/1332] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:22.888359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8ac05-c83f-47f4-ac82-545d351b61c7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:22.888793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8ac05-c83f-47f4-ac82-545d351b61c7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:22.889003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8ac05-c83f-47f4-ac82-545d351b61c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:22.951830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d6b8ac05-c83f-47f4-ac82-545d351b61c7 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:22.953012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d6b8ac05-c83f-47f4-ac82-545d351b61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:23.046861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 658/1333] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:06:23.082622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f86b-5e2c-4e89-be9c-d53e83e65816 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:23.084141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-87b7f86b-5e2c-4e89-be9c-d53e83e65816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:23.183614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f86b-5e2c-4e89-be9c-d53e83e65816 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:23.253162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912ebb6-a25c-4217-aaaa-ba70569ca7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:23.253821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912ebb6-a25c-4217-aaaa-ba70569ca7ee service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:23.254129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912ebb6-a25c-4217-aaaa-ba70569ca7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:23.254401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912ebb6-a25c-4217-aaaa-ba70569ca7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:23.256110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1912ebb6-a25c-4217-aaaa-ba70569ca7ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:23.369945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912ebb6-a25c-4217-aaaa-ba70569ca7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:23.371473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912ebb6-a25c-4217-aaaa-ba70569ca7ee service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:23.390594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 676/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:25.648504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df287-6c7b-429b-88fc-eebef0c76d8b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:25.649042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df287-6c7b-429b-88fc-eebef0c76d8b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:25.649042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429df287-6c7b-429b-88fc-eebef0c76d8b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:25.650949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 659/1335] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:25.656236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ed7b-c551-4522-8125-b8958645e94d None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:25.656653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ed7b-c551-4522-8125-b8958645e94d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:25.656787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ed7b-c551-4522-8125-b8958645e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:25.718063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-1352ed7b-c551-4522-8125-b8958645e94d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:25.719265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1352ed7b-c551-4522-8125-b8958645e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:25.808649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 677/1336] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:25.848708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429df287-6c7b-429b-88fc-eebef0c76d8b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:25.850300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-429df287-6c7b-429b-88fc-eebef0c76d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:25.952099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429df287-6c7b-429b-88fc-eebef0c76d8b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:26.020568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711995bc-e623-4886-b304-9e0be2791889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:26.021206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711995bc-e623-4886-b304-9e0be2791889 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:26.021484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711995bc-e623-4886-b304-9e0be2791889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:26.021756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711995bc-e623-4886-b304-9e0be2791889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:26.023402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-711995bc-e623-4886-b304-9e0be2791889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:26.131626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711995bc-e623-4886-b304-9e0be2791889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:26.133061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711995bc-e623-4886-b304-9e0be2791889 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:26.151139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 660/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:29.010464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e14c4-1f5e-4192-bdf5-e01dd6ce77b5 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:29.010979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e14c4-1f5e-4192-bdf5-e01dd6ce77b5 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:29.011072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e14c4-1f5e-4192-bdf5-e01dd6ce77b5 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:29.012386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 678/1338] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:29.017541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94858b6c-7089-4930-a07b-d36d798ddcbd None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:29.017981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94858b6c-7089-4930-a07b-d36d798ddcbd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:29.018129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94858b6c-7089-4930-a07b-d36d798ddcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:29.081663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-94858b6c-7089-4930-a07b-d36d798ddcbd None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:29.082920 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-94858b6c-7089-4930-a07b-d36d798ddcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:29.175131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 661/1339] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:29.209959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e14c4-1f5e-4192-bdf5-e01dd6ce77b5 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:29.211485 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0f0e14c4-1f5e-4192-bdf5-e01dd6ce77b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:29.309788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e14c4-1f5e-4192-bdf5-e01dd6ce77b5 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:29.378340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335412c6-5f35-4308-a7a7-e25fdbdf5930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:29.378984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335412c6-5f35-4308-a7a7-e25fdbdf5930 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:29.379259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335412c6-5f35-4308-a7a7-e25fdbdf5930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:29.379529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335412c6-5f35-4308-a7a7-e25fdbdf5930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:29.381142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-335412c6-5f35-4308-a7a7-e25fdbdf5930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:29.483549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335412c6-5f35-4308-a7a7-e25fdbdf5930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:29.484917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335412c6-5f35-4308-a7a7-e25fdbdf5930 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:29.502936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 679/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:33.935019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9696f4d-487c-441f-b4cd-d9a1164bf937 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:33.935565 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9696f4d-487c-441f-b4cd-d9a1164bf937 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:33.935565 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9696f4d-487c-441f-b4cd-d9a1164bf937 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:33.936973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 662/1341] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:33.942377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383d39-6931-4995-bd96-a8915a1f5cd9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:33.942822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383d39-6931-4995-bd96-a8915a1f5cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:33.942918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef383d39-6931-4995-bd96-a8915a1f5cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:34.013351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ef383d39-6931-4995-bd96-a8915a1f5cd9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:34.014500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ef383d39-6931-4995-bd96-a8915a1f5cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:34.114745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 680/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:06:34.152849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9696f4d-487c-441f-b4cd-d9a1164bf937 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:34.155059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d9696f4d-487c-441f-b4cd-d9a1164bf937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:34.246993 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9696f4d-487c-441f-b4cd-d9a1164bf937 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:34.250584 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab29c9-c9a9-4027-8abb-4e8162d92366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:34.251264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab29c9-c9a9-4027-8abb-4e8162d92366 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:34.251536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab29c9-c9a9-4027-8abb-4e8162d92366 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:34.251806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab29c9-c9a9-4027-8abb-4e8162d92366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:34.260525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab29c9-c9a9-4027-8abb-4e8162d92366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:34.261945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab29c9-c9a9-4027-8abb-4e8162d92366 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:34.271396 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 663/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:37.371246 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36ada-b39a-491b-aea2-70190081073f None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:37.371794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36ada-b39a-491b-aea2-70190081073f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:37.371794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36ada-b39a-491b-aea2-70190081073f None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:37.373164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 681/1344] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:37.378388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f54b7f-6643-4019-8a02-2c138deb4a05 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:37.378776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f54b7f-6643-4019-8a02-2c138deb4a05 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:37.379060 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f54b7f-6643-4019-8a02-2c138deb4a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:37.406511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c4f54b7f-6643-4019-8a02-2c138deb4a05 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:37.407689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c4f54b7f-6643-4019-8a02-2c138deb4a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:37.482444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 664/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:06:37.518610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36ada-b39a-491b-aea2-70190081073f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:37.529649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36ada-b39a-491b-aea2-70190081073f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:37.533132 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ce4a9-e81c-4e8f-a4eb-e1f6bf2c6788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:37.533763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce4a9-e81c-4e8f-a4eb-e1f6bf2c6788 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:37.534081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce4a9-e81c-4e8f-a4eb-e1f6bf2c6788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:37.534343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce4a9-e81c-4e8f-a4eb-e1f6bf2c6788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:37.543882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ce4a9-e81c-4e8f-a4eb-e1f6bf2c6788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:37.545305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ce4a9-e81c-4e8f-a4eb-e1f6bf2c6788 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:37.554677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 682/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:42.055208 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df35e-d70b-4de0-8a60-ea2c7e48095b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:42.055626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df35e-d70b-4de0-8a60-ea2c7e48095b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:42.055798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df35e-d70b-4de0-8a60-ea2c7e48095b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:42.060721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 665/1347] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:42.062382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f4d65-c490-44d4-abcb-3bd42d28afa5 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:42.062806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f4d65-c490-44d4-abcb-3bd42d28afa5 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:42.062976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f4d65-c490-44d4-abcb-3bd42d28afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:42.090628 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-851f4d65-c490-44d4-abcb-3bd42d28afa5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:42.092124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-851f4d65-c490-44d4-abcb-3bd42d28afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:42.101054 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 683/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:42.139142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df35e-d70b-4de0-8a60-ea2c7e48095b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:42.140839 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d38df35e-d70b-4de0-8a60-ea2c7e48095b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:42.154303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df35e-d70b-4de0-8a60-ea2c7e48095b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:42.158083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cf15a-5f86-4b81-9cc5-2eb9990ed938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:42.158430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf15a-5f86-4b81-9cc5-2eb9990ed938 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:42.158713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf15a-5f86-4b81-9cc5-2eb9990ed938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:42.158983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cf15a-5f86-4b81-9cc5-2eb9990ed938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:42.169005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cf15a-5f86-4b81-9cc5-2eb9990ed938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:42.170669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cf15a-5f86-4b81-9cc5-2eb9990ed938 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:42.180461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 666/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:06:47.446709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c84f4-51e1-474f-a813-d0ebdb6af451 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:47.450568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c84f4-51e1-474f-a813-d0ebdb6af451 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:47.450961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c84f4-51e1-474f-a813-d0ebdb6af451 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:47.452660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 684/1350] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:06:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:47.457543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9f405-9643-4f5a-96b8-bfcfbe44f16b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:47.481143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9f405-9643-4f5a-96b8-bfcfbe44f16b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:47.481706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9f405-9643-4f5a-96b8-bfcfbe44f16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:47.564440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-40a9f405-9643-4f5a-96b8-bfcfbe44f16b None None] MFA Rules not processed for user `6dfdb39ae2804b2191cea53f2a387c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:47.565609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-40a9f405-9643-4f5a-96b8-bfcfbe44f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:47.638900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 667/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:06:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:06:51.992759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4471-1ca7-4960-947e-486636627639 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:51.993325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4471-1ca7-4960-947e-486636627639 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:51.993615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4471-1ca7-4960-947e-486636627639 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:51.995134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 685/1352] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:52.003556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e8291-2e06-4c8b-81a0-05d61e70327e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:52.006889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e8291-2e06-4c8b-81a0-05d61e70327e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:52.007455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e8291-2e06-4c8b-81a0-05d61e70327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:52.027267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-147e8291-2e06-4c8b-81a0-05d61e70327e None None] MFA Rules not processed for user `6dfdb39ae2804b2191cea53f2a387c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:52.028891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-147e8291-2e06-4c8b-81a0-05d61e70327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:52.039474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 668/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:06:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:53.470390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fb5cb-2778-4a37-a87a-b403ecc508a9 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:53.470912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fb5cb-2778-4a37-a87a-b403ecc508a9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:53.470912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fb5cb-2778-4a37-a87a-b403ecc508a9 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:53.472245 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 686/1354] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:53.477716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13a609-af32-4b69-ae16-495eb0366fbf None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:53.478165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13a609-af32-4b69-ae16-495eb0366fbf None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:53.478307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13a609-af32-4b69-ae16-495eb0366fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:53.496252 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4a13a609-af32-4b69-ae16-495eb0366fbf None None] MFA Rules not processed for user `6dfdb39ae2804b2191cea53f2a387c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:53.497504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4a13a609-af32-4b69-ae16-495eb0366fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:53.506544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 669/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:06:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:06:57.332536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da925d-851b-4616-9516-d0a4bd759332 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:57.333116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da925d-851b-4616-9516-d0a4bd759332 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:57.333383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da925d-851b-4616-9516-d0a4bd759332 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:57.335023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 687/1356] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:57.339969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483c51-8fdd-4fbd-b317-0f7d5b00174d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:57.340365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483c51-8fdd-4fbd-b317-0f7d5b00174d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:57.340515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483c51-8fdd-4fbd-b317-0f7d5b00174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:57.358489 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-18483c51-8fdd-4fbd-b317-0f7d5b00174d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:57.359654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-18483c51-8fdd-4fbd-b317-0f7d5b00174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:57.368290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 670/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:57.415726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd00527-8e05-4d66-81a6-f1cfeedeb08a None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:57.416377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd00527-8e05-4d66-81a6-f1cfeedeb08a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:57.416656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd00527-8e05-4d66-81a6-f1cfeedeb08a None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:57.418207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 688/1358] 10.222.0.44 () {54 vars in 961 bytes} [Mon May 16 15:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:06:57.424082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2e3ae-c8fb-4fa3-b58f-4d2ac788cc9d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:57.424520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2e3ae-c8fb-4fa3-b58f-4d2ac788cc9d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:57.425454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2e3ae-c8fb-4fa3-b58f-4d2ac788cc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:57.473225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7fa2e3ae-c8fb-4fa3-b58f-4d2ac788cc9d None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:06:57.474420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7fa2e3ae-c8fb-4fa3-b58f-4d2ac788cc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:06:57.554419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 671/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Mon May 16 15:06:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:06:57.563097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd00527-8e05-4d66-81a6-f1cfeedeb08a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:06:57.577530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd00527-8e05-4d66-81a6-f1cfeedeb08a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:06:57.583797 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05944d96-ccc1-4950-8057-8a5a844d55e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:06:57.584450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05944d96-ccc1-4950-8057-8a5a844d55e3 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:06:57.584852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05944d96-ccc1-4950-8057-8a5a844d55e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:06:57.585295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05944d96-ccc1-4950-8057-8a5a844d55e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:06:57.594349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05944d96-ccc1-4950-8057-8a5a844d55e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:06:57.596170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05944d96-ccc1-4950-8057-8a5a844d55e3 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:06:57.606854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 689/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:00.045702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25225d16-7106-4634-a124-da1c408e70cb None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:00.046265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25225d16-7106-4634-a124-da1c408e70cb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:00.046265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25225d16-7106-4634-a124-da1c408e70cb None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:00.047687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 672/1361] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:00.053468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4832a9-b594-46cc-a606-7fcfe0fce7a7 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:00.053883 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4832a9-b594-46cc-a606-7fcfe0fce7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:00.054027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4832a9-b594-46cc-a606-7fcfe0fce7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:00.073932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8d4832a9-b594-46cc-a606-7fcfe0fce7a7 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:00.075183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8d4832a9-b594-46cc-a606-7fcfe0fce7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:00.084313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 690/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:00.130859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25225d16-7106-4634-a124-da1c408e70cb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:00.149235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25225d16-7106-4634-a124-da1c408e70cb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:00.155087 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff6d8d-8b17-4710-bf9e-a4a7b7560e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:00.155725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff6d8d-8b17-4710-bf9e-a4a7b7560e39 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:00.156004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff6d8d-8b17-4710-bf9e-a4a7b7560e39 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:00.156275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff6d8d-8b17-4710-bf9e-a4a7b7560e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:00.165694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff6d8d-8b17-4710-bf9e-a4a7b7560e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:00.167286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff6d8d-8b17-4710-bf9e-a4a7b7560e39 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:00.176838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 673/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:07:02.836213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9f6da-5b18-474e-9c78-8ff4712d6e8e None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:02.836698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9f6da-5b18-474e-9c78-8ff4712d6e8e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:02.836698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9f6da-5b18-474e-9c78-8ff4712d6e8e None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:02.838182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 691/1364] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:02.843586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa098ced-7ab9-4001-8442-6fd9f2038abf None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:02.844059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa098ced-7ab9-4001-8442-6fd9f2038abf None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:02.844227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa098ced-7ab9-4001-8442-6fd9f2038abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:02.862617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fa098ced-7ab9-4001-8442-6fd9f2038abf None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:02.863788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fa098ced-7ab9-4001-8442-6fd9f2038abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:02.871541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 674/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:02.915925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e4ebf-b1f2-4fba-99fb-4b9165dd6d9d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:02.916214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e4ebf-b1f2-4fba-99fb-4b9165dd6d9d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:02.916489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e4ebf-b1f2-4fba-99fb-4b9165dd6d9d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:02.917919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 692/1366] 10.222.0.44 () {54 vars in 961 bytes} [Mon May 16 15:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:02.923363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2ed20-a527-43e2-94a5-968ca31bb25d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:02.923676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2ed20-a527-43e2-94a5-968ca31bb25d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:02.923950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2ed20-a527-43e2-94a5-968ca31bb25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:02.941276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-aea2ed20-a527-43e2-94a5-968ca31bb25d None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:02.942476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-aea2ed20-a527-43e2-94a5-968ca31bb25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:02.951526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 675/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Mon May 16 15:07:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:07:02.959639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e4ebf-b1f2-4fba-99fb-4b9165dd6d9d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:02.973843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e4ebf-b1f2-4fba-99fb-4b9165dd6d9d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:02.979202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337a42e-430f-4723-866b-92b178749246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:02.979819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337a42e-430f-4723-866b-92b178749246 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:02.980095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337a42e-430f-4723-866b-92b178749246 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:02.980365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337a42e-430f-4723-866b-92b178749246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:02.988442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337a42e-430f-4723-866b-92b178749246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:02.990007 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337a42e-430f-4723-866b-92b178749246 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:03.001608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 693/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:05.472932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764982-8e90-466f-b858-d1f643c3e196 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:05.473478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764982-8e90-466f-b858-d1f643c3e196 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:05.473478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764982-8e90-466f-b858-d1f643c3e196 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:05.474778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 676/1369] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:05.480670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828b42f-cf6f-4c9d-97c0-03a5c068f299 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:05.481081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828b42f-cf6f-4c9d-97c0-03a5c068f299 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:05.481222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828b42f-cf6f-4c9d-97c0-03a5c068f299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:05.499525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-6828b42f-cf6f-4c9d-97c0-03a5c068f299 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:05.501032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6828b42f-cf6f-4c9d-97c0-03a5c068f299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:05.509151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 694/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:07:05.555606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06764982-8e90-466f-b858-d1f643c3e196 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:05.557418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6441-103c-47bd-93ff-81c12dc57f59 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:05.557837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6441-103c-47bd-93ff-81c12dc57f59 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:05.558227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6441-103c-47bd-93ff-81c12dc57f59 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:05.559716 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 695/1371] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:05.565566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e1e46-f35d-4bca-a3d2-e74bca357b55 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:05.565852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e1e46-f35d-4bca-a3d2-e74bca357b55 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:05.566368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e1e46-f35d-4bca-a3d2-e74bca357b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:05.572886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06764982-8e90-466f-b858-d1f643c3e196 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:05.580319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615fae4-f30f-4d33-8018-e0fe76d0c85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:05.582075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615fae4-f30f-4d33-8018-e0fe76d0c85f service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:05.582382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615fae4-f30f-4d33-8018-e0fe76d0c85f service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:05.582664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615fae4-f30f-4d33-8018-e0fe76d0c85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:05.584925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-401e1e46-f35d-4bca-a3d2-e74bca357b55 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:05.586173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-401e1e46-f35d-4bca-a3d2-e74bca357b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:05.592320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615fae4-f30f-4d33-8018-e0fe76d0c85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:05.593953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615fae4-f30f-4d33-8018-e0fe76d0c85f service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:05.598611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 696/1372] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:07:05.606442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 677/1373] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:05.909090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67eb3ce-1325-41c5-93b7-645b2e6b7cf4 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:05.909090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67eb3ce-1325-41c5-93b7-645b2e6b7cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:05.909090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67eb3ce-1325-41c5-93b7-645b2e6b7cf4 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:05.909090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 697/1374] 10.222.0.44 () {54 vars in 963 bytes} [Mon May 16 15:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:05.914424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0fdd-35eb-4e2a-9ab9-f9aacce1edaa None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:05.914714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0fdd-35eb-4e2a-9ab9-f9aacce1edaa None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:05.914990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0fdd-35eb-4e2a-9ab9-f9aacce1edaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:05.970538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bb9f0fdd-35eb-4e2a-9ab9-f9aacce1edaa None None] MFA Rules not processed for user `55591aa3b6324ce99d1529beb8f6de2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:05.971919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bb9f0fdd-35eb-4e2a-9ab9-f9aacce1edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:06.037076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 678/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Mon May 16 15:07:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:06.045229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67eb3ce-1325-41c5-93b7-645b2e6b7cf4 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:06.056084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67eb3ce-1325-41c5-93b7-645b2e6b7cf4 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:06.059883 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922a99b-4763-4d72-8057-b244a368e5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:06.060695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922a99b-4763-4d72-8057-b244a368e5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:06.061067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922a99b-4763-4d72-8057-b244a368e5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:06.061441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922a99b-4763-4d72-8057-b244a368e5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:06.071528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922a99b-4763-4d72-8057-b244a368e5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:06.073230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922a99b-4763-4d72-8057-b244a368e5d3 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:06.090878 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 698/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:07:07.998684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e574ce0-0982-49ac-85ce-4d91df9e4150 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:07.999824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e574ce0-0982-49ac-85ce-4d91df9e4150 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:08.000370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e574ce0-0982-49ac-85ce-4d91df9e4150 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:08.002103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 679/1377] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:08.008109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d33f5-ff32-490a-96df-927493e83446 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:08.008562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d33f5-ff32-490a-96df-927493e83446 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:08.008658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d33f5-ff32-490a-96df-927493e83446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:08.025994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7b3d33f5-ff32-490a-96df-927493e83446 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:08.027235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7b3d33f5-ff32-490a-96df-927493e83446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:08.035803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 699/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:08.080681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e574ce0-0982-49ac-85ce-4d91df9e4150 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:08.097236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e574ce0-0982-49ac-85ce-4d91df9e4150 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:08.102937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448d33-6748-48d3-89b1-294b430236df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:08.103580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448d33-6748-48d3-89b1-294b430236df service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:08.103866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448d33-6748-48d3-89b1-294b430236df service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:08.104144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448d33-6748-48d3-89b1-294b430236df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:08.112858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45448d33-6748-48d3-89b1-294b430236df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:08.114511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45448d33-6748-48d3-89b1-294b430236df service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:08.123723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 680/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:10.525110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b307a1-e924-4d80-9c24-f5fc0f4d2a44 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:10.526000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b307a1-e924-4d80-9c24-f5fc0f4d2a44 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:10.526315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b307a1-e924-4d80-9c24-f5fc0f4d2a44 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:10.527903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 700/1380] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:10.533263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581724f-7322-4c9d-9bb0-fc0183a8f00c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:10.533691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581724f-7322-4c9d-9bb0-fc0183a8f00c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:10.533870 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581724f-7322-4c9d-9bb0-fc0183a8f00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:10.552762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b581724f-7322-4c9d-9bb0-fc0183a8f00c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:10.554181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b581724f-7322-4c9d-9bb0-fc0183a8f00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:10.562149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 681/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:10.605448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b307a1-e924-4d80-9c24-f5fc0f4d2a44 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:10.621649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b307a1-e924-4d80-9c24-f5fc0f4d2a44 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:10.627804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3863998-8bd5-42bf-b0e9-5cb267c501e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:10.628554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3863998-8bd5-42bf-b0e9-5cb267c501e9 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:10.628933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3863998-8bd5-42bf-b0e9-5cb267c501e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:10.629308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3863998-8bd5-42bf-b0e9-5cb267c501e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:10.637266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3863998-8bd5-42bf-b0e9-5cb267c501e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:10.639014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3863998-8bd5-42bf-b0e9-5cb267c501e9 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:10.648403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 701/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:13.016754 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77881c02-9079-4386-a155-e7f0e28b779b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:13.017336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77881c02-9079-4386-a155-e7f0e28b779b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:13.017336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77881c02-9079-4386-a155-e7f0e28b779b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:13.018678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 682/1383] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:13.023891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02de60d-66f2-46b1-a3a9-0f493c405e42 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:13.024303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02de60d-66f2-46b1-a3a9-0f493c405e42 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:13.024431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02de60d-66f2-46b1-a3a9-0f493c405e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:13.042286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e02de60d-66f2-46b1-a3a9-0f493c405e42 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:13.043566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e02de60d-66f2-46b1-a3a9-0f493c405e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:13.051839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 702/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:13.092773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77881c02-9079-4386-a155-e7f0e28b779b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:13.107861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77881c02-9079-4386-a155-e7f0e28b779b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:13.113999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0c4c9-3dbe-4b03-933b-fe6172807e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:13.114666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0c4c9-3dbe-4b03-933b-fe6172807e71 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:13.114944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0c4c9-3dbe-4b03-933b-fe6172807e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:13.115213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0c4c9-3dbe-4b03-933b-fe6172807e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:13.123450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0c4c9-3dbe-4b03-933b-fe6172807e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:13.125055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0c4c9-3dbe-4b03-933b-fe6172807e71 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:13.134518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 683/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:15.362664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f5149-7e40-48a6-988f-43f538bd5a2d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:15.363180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f5149-7e40-48a6-988f-43f538bd5a2d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:15.363180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f5149-7e40-48a6-988f-43f538bd5a2d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:15.364570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 703/1386] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:15.369922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf8d2-a5ba-42d0-b371-94f10816db8f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:15.370450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf8d2-a5ba-42d0-b371-94f10816db8f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:15.370623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf8d2-a5ba-42d0-b371-94f10816db8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:15.388194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-86bdf8d2-a5ba-42d0-b371-94f10816db8f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:15.389392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-86bdf8d2-a5ba-42d0-b371-94f10816db8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:15.397223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 684/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:15.442445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f5149-7e40-48a6-988f-43f538bd5a2d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:15.457174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f5149-7e40-48a6-988f-43f538bd5a2d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:15.462627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889186d5-7a0b-49b4-822d-1a5fc42c74ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:15.463261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889186d5-7a0b-49b4-822d-1a5fc42c74ba service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:15.463544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889186d5-7a0b-49b4-822d-1a5fc42c74ba service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:15.463821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889186d5-7a0b-49b4-822d-1a5fc42c74ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:15.472370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889186d5-7a0b-49b4-822d-1a5fc42c74ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:15.473956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889186d5-7a0b-49b4-822d-1a5fc42c74ba service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:15.483458 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 704/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:17.903971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a913b-4163-4f3a-9c13-60740e8434a3 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:17.904700 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a913b-4163-4f3a-9c13-60740e8434a3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:17.904700 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a913b-4163-4f3a-9c13-60740e8434a3 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:17.906597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 685/1389] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:17.912008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9869c-7258-4ff9-880b-ca56e397c901 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:17.912417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9869c-7258-4ff9-880b-ca56e397c901 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:17.912551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9869c-7258-4ff9-880b-ca56e397c901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:17.929713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e9d9869c-7258-4ff9-880b-ca56e397c901 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:17.930931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e9d9869c-7258-4ff9-880b-ca56e397c901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:17.938751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 705/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:17.982307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a913b-4163-4f3a-9c13-60740e8434a3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:17.996785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a913b-4163-4f3a-9c13-60740e8434a3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:18.002972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ba45-eea8-4cd6-a56b-dcceb7147f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:18.003624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ba45-eea8-4cd6-a56b-dcceb7147f83 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:18.003905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ba45-eea8-4cd6-a56b-dcceb7147f83 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:18.004171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ba45-eea8-4cd6-a56b-dcceb7147f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:18.012707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071ba45-eea8-4cd6-a56b-dcceb7147f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:18.014313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071ba45-eea8-4cd6-a56b-dcceb7147f83 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:18.024322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 686/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:20.388554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd815-5fbf-416b-940a-afa6cd019b9d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:20.389119 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd815-5fbf-416b-940a-afa6cd019b9d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:20.389119 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd815-5fbf-416b-940a-afa6cd019b9d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:20.390594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 706/1392] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:20.396245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b04018-f8f1-4759-95d6-4ff299cc4e76 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:20.396658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b04018-f8f1-4759-95d6-4ff299cc4e76 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:20.396826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b04018-f8f1-4759-95d6-4ff299cc4e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:20.414681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e4b04018-f8f1-4759-95d6-4ff299cc4e76 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:20.415877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e4b04018-f8f1-4759-95d6-4ff299cc4e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:20.423458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 687/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:20.467348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd815-5fbf-416b-940a-afa6cd019b9d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:20.481534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd815-5fbf-416b-940a-afa6cd019b9d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:20.487338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8a896-f914-4269-ac31-348ab038540f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:20.487700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8a896-f914-4269-ac31-348ab038540f service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:20.487984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8a896-f914-4269-ac31-348ab038540f service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:20.488256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8a896-f914-4269-ac31-348ab038540f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:20.496296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8a896-f914-4269-ac31-348ab038540f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:20.497866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8a896-f914-4269-ac31-348ab038540f service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:20.507426 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 707/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:21.998841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b1cc4-08f0-4db5-8735-1404a66beb8c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:21.999412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b1cc4-08f0-4db5-8735-1404a66beb8c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:21.999412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b1cc4-08f0-4db5-8735-1404a66beb8c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.000962 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 688/1395] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:22.006313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6460be-9e44-4b78-a00e-df7d79a2771f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:22.006804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6460be-9e44-4b78-a00e-df7d79a2771f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:22.006896 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6460be-9e44-4b78-a00e-df7d79a2771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.023746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-cb6460be-9e44-4b78-a00e-df7d79a2771f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:22.024966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-cb6460be-9e44-4b78-a00e-df7d79a2771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:22.033288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 708/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:07:22.090351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f82b7f-cb87-4ab4-ac02-bb75d3ec44eb None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:22.090641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f82b7f-cb87-4ab4-ac02-bb75d3ec44eb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:22.090917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f82b7f-cb87-4ab4-ac02-bb75d3ec44eb None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.092272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 689/1397] 10.222.0.44 () {54 vars in 962 bytes} [Mon May 16 15:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:22.097596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e15b7-4d29-4cf0-a6c9-7d9cedb7ce4b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:22.097888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e15b7-4d29-4cf0-a6c9-7d9cedb7ce4b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:22.098216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e15b7-4d29-4cf0-a6c9-7d9cedb7ce4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.144452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-1d1e15b7-4d29-4cf0-a6c9-7d9cedb7ce4b None None] MFA Rules not processed for user `d9237b353da546989b399ee9702d1bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:22.145625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1d1e15b7-4d29-4cf0-a6c9-7d9cedb7ce4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:22.201993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 709/1398] 10.222.0.44 () {58 vars in 1059 bytes} [Mon May 16 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:22.209200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f82b7f-cb87-4ab4-ac02-bb75d3ec44eb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:22.220016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f82b7f-cb87-4ab4-ac02-bb75d3ec44eb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:22.223597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288a837-8e94-49fd-a551-765a2ae712b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9237b353da546989b399ee9702d1bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:22.224216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a837-8e94-49fd-a551-765a2ae712b9 service glance] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:22.224603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a837-8e94-49fd-a551-765a2ae712b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:22.224878 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a837-8e94-49fd-a551-765a2ae712b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.233744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288a837-8e94-49fd-a551-765a2ae712b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:22.235851 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288a837-8e94-49fd-a551-765a2ae712b9 service glance] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:22.244876 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 690/1399] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:22.837651 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506745a-1156-40f3-a402-877fb1241280 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:22.837936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506745a-1156-40f3-a402-877fb1241280 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:22.838237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506745a-1156-40f3-a402-877fb1241280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.884576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d506745a-1156-40f3-a402-877fb1241280 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:22.885695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d506745a-1156-40f3-a402-877fb1241280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:22.892349 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07f293-3fb5-40cd-a32f-b2f23ae9f557 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:22.892668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07f293-3fb5-40cd-a32f-b2f23ae9f557 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:22.892973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07f293-3fb5-40cd-a32f-b2f23ae9f557 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.894384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 691/1400] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:07:22.899387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b65316-e85d-4f43-b8b0-740ee68ec449 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:22.899670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b65316-e85d-4f43-b8b0-740ee68ec449 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:22.899938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b65316-e85d-4f43-b8b0-740ee68ec449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.916741 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-83b65316-e85d-4f43-b8b0-740ee68ec449 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:22.917901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-83b65316-e85d-4f43-b8b0-740ee68ec449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:22.925663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 692/1401] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:07:22.947927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 710/1402] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:22.969708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b65316-e85d-4f43-b8b0-740ee68ec449 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:22.982202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b65316-e85d-4f43-b8b0-740ee68ec449 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:22.987685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f53a7-36ff-45ca-a82c-f16b86ae9ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:22.988327 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f53a7-36ff-45ca-a82c-f16b86ae9ec5 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:22.988604 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f53a7-36ff-45ca-a82c-f16b86ae9ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:22.988875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f53a7-36ff-45ca-a82c-f16b86ae9ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.993662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096603-583e-4c89-b955-eb670b9ec116 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:22.994246 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096603-583e-4c89-b955-eb670b9ec116 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:22.994530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096603-583e-4c89-b955-eb670b9ec116 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:22.995914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 711/1403] 10.222.0.44 () {54 vars in 942 bytes} [Mon May 16 15:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 15:07:22.997600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f53a7-36ff-45ca-a82c-f16b86ae9ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:22.999118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f53a7-36ff-45ca-a82c-f16b86ae9ec5 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:23.003884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afbeec-e35d-4b50-8fac-69579e9c6266 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:23.004177 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afbeec-e35d-4b50-8fac-69579e9c6266 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:23.004457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afbeec-e35d-4b50-8fac-69579e9c6266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:23.009448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 693/1404] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:23.051297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-83afbeec-e35d-4b50-8fac-69579e9c6266 None None] MFA Rules not processed for user `6a6668cb0bda4d61b6b96f547a422830`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:23.052517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-83afbeec-e35d-4b50-8fac-69579e9c6266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:23.124229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 712/1405] 10.222.0.44 () {58 vars in 1039 bytes} [Mon May 16 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:07:23.140945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f53a7-36ff-45ca-a82c-f16b86ae9ec5 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:23.145965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f53a7-36ff-45ca-a82c-f16b86ae9ec5 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:23.151043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd19f7-e4f9-4a62-a4c8-08b61349f207 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:23.151703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd19f7-e4f9-4a62-a4c8-08b61349f207 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:23.151997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd19f7-e4f9-4a62-a4c8-08b61349f207 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:23.152249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd19f7-e4f9-4a62-a4c8-08b61349f207 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:23.160373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd19f7-e4f9-4a62-a4c8-08b61349f207 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:23.161985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd19f7-e4f9-4a62-a4c8-08b61349f207 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:23.169930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 694/1406] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:07:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:07:25.423827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db488404-569e-48c8-8d32-e6e846b069d7 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:25.424346 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db488404-569e-48c8-8d32-e6e846b069d7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:25.424346 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db488404-569e-48c8-8d32-e6e846b069d7 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:25.425663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 713/1407] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:25.431006 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14635-4cec-4ca9-8474-b154247d6503 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:25.431424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14635-4cec-4ca9-8474-b154247d6503 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:25.431572 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14635-4cec-4ca9-8474-b154247d6503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:25.460014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b1d14635-4cec-4ca9-8474-b154247d6503 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:25.461229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b1d14635-4cec-4ca9-8474-b154247d6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:25.469673 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 695/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:25.522550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db488404-569e-48c8-8d32-e6e846b069d7 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:25.543657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db488404-569e-48c8-8d32-e6e846b069d7 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:25.549820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744e971-1c5f-4c38-b141-8b77a43863a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:25.550502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744e971-1c5f-4c38-b141-8b77a43863a6 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:25.550783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744e971-1c5f-4c38-b141-8b77a43863a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:25.551059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744e971-1c5f-4c38-b141-8b77a43863a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:25.561705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744e971-1c5f-4c38-b141-8b77a43863a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:25.563535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744e971-1c5f-4c38-b141-8b77a43863a6 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:25.572968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 714/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:47.343809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d1e4e-e0d1-41c9-bb37-cf7aa67a2836 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:47.344445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d1e4e-e0d1-41c9-bb37-cf7aa67a2836 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:47.344445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d1e4e-e0d1-41c9-bb37-cf7aa67a2836 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:47.345663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 696/1410] 10.222.0.44 () {54 vars in 918 bytes} [Mon May 16 15:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:47.351503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341b2a-5a7e-41b5-a56d-834778547d23 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:47.351961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341b2a-5a7e-41b5-a56d-834778547d23 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:47.352063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341b2a-5a7e-41b5-a56d-834778547d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:47.369766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-00341b2a-5a7e-41b5-a56d-834778547d23 None None] MFA Rules not processed for user `6dfdb39ae2804b2191cea53f2a387c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:47.370993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-00341b2a-5a7e-41b5-a56d-834778547d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:47.379982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 715/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Mon May 16 15:07:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:47.393833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63060d34-3684-480d-aa7b-fac677c87cb2 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:47.394153 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63060d34-3684-480d-aa7b-fac677c87cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:47.394438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63060d34-3684-480d-aa7b-fac677c87cb2 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:47.395844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 697/1412] 10.222.0.44 () {54 vars in 918 bytes} [Mon May 16 15:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:47.400210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9779977-9c8b-486e-a385-013056ee9e32 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:47.400497 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9779977-9c8b-486e-a385-013056ee9e32 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:47.400774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9779977-9c8b-486e-a385-013056ee9e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:47.418385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c9779977-9c8b-486e-a385-013056ee9e32 None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:47.420096 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c9779977-9c8b-486e-a385-013056ee9e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:47.428885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 716/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Mon May 16 15:07:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:50.066979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dc65a-0dda-45e8-9501-b116fdf1ac82 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:50.067543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dc65a-0dda-45e8-9501-b116fdf1ac82 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:50.067543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dc65a-0dda-45e8-9501-b116fdf1ac82 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:50.068963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:50.074151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c186a-3d78-4829-9cd0-2ef325d6cf9c None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:50.078591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c186a-3d78-4829-9cd0-2ef325d6cf9c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:50.078944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c186a-3d78-4829-9cd0-2ef325d6cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:50.096787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-4b1c186a-3d78-4829-9cd0-2ef325d6cf9c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:50.097977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4b1c186a-3d78-4829-9cd0-2ef325d6cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:50.106075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:50.146745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dc65a-0dda-45e8-9501-b116fdf1ac82 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:50.161306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dc65a-0dda-45e8-9501-b116fdf1ac82 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:50.166627 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52786c-6dc7-45c2-9c50-4d55346e2245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:50.167253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52786c-6dc7-45c2-9c50-4d55346e2245 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:50.167536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52786c-6dc7-45c2-9c50-4d55346e2245 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:50.167810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52786c-6dc7-45c2-9c50-4d55346e2245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:50.175719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52786c-6dc7-45c2-9c50-4d55346e2245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:50.177295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52786c-6dc7-45c2-9c50-4d55346e2245 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:50.186525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 699/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:51.165870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195c6bf-b648-405f-b77b-55067e14df3f None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:51.166448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195c6bf-b648-405f-b77b-55067e14df3f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:51.166448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195c6bf-b648-405f-b77b-55067e14df3f None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:51.167857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:51.173410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee643207-2d46-434b-97b3-9f2bbea3b75a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:51.173834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee643207-2d46-434b-97b3-9f2bbea3b75a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:51.173961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee643207-2d46-434b-97b3-9f2bbea3b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:51.191302 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ee643207-2d46-434b-97b3-9f2bbea3b75a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:51.192511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ee643207-2d46-434b-97b3-9f2bbea3b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:51.200492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:51.357393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195c6bf-b648-405f-b77b-55067e14df3f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:51.371211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195c6bf-b648-405f-b77b-55067e14df3f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:51.376442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7ac61-b60b-4bd8-8e4d-9dae2250a7e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:51.377066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7ac61-b60b-4bd8-8e4d-9dae2250a7e5 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:51.377342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7ac61-b60b-4bd8-8e4d-9dae2250a7e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:51.377615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7ac61-b60b-4bd8-8e4d-9dae2250a7e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:51.385483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7ac61-b60b-4bd8-8e4d-9dae2250a7e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:51.387140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7ac61-b60b-4bd8-8e4d-9dae2250a7e5 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:51.396099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 719/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:52.335860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062efd72-b79e-42fc-a2f7-17a68e495ced None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:52.336397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062efd72-b79e-42fc-a2f7-17a68e495ced None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:52.336397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062efd72-b79e-42fc-a2f7-17a68e495ced None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:52.337743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:52.343123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc7bfe-77d9-497a-95e6-e05017402d68 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:52.343533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc7bfe-77d9-497a-95e6-e05017402d68 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:52.343673 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc7bfe-77d9-497a-95e6-e05017402d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:52.361720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-affc7bfe-77d9-497a-95e6-e05017402d68 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:52.362985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-affc7bfe-77d9-497a-95e6-e05017402d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:52.370546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:52.519280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062efd72-b79e-42fc-a2f7-17a68e495ced None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:52.533105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062efd72-b79e-42fc-a2f7-17a68e495ced None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:52.538613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc047799-288d-418a-821b-f024bab1eac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:52.539230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc047799-288d-418a-821b-f024bab1eac2 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:52.539508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc047799-288d-418a-821b-f024bab1eac2 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:52.539779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc047799-288d-418a-821b-f024bab1eac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:52.547936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc047799-288d-418a-821b-f024bab1eac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:52.549488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc047799-288d-418a-821b-f024bab1eac2 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:52.558334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 702/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:53.473067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07bd8f-7e34-4a28-bde1-18e391ca8b7b None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:53.473587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07bd8f-7e34-4a28-bde1-18e391ca8b7b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:53.473587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07bd8f-7e34-4a28-bde1-18e391ca8b7b None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:53.475201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:53.480792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211f5e9-934c-414b-884a-687c546aea17 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:53.481217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211f5e9-934c-414b-884a-687c546aea17 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:53.481383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211f5e9-934c-414b-884a-687c546aea17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:53.499044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2211f5e9-934c-414b-884a-687c546aea17 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:53.504638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2211f5e9-934c-414b-884a-687c546aea17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:53.507890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:53.655935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07bd8f-7e34-4a28-bde1-18e391ca8b7b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:53.670433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07bd8f-7e34-4a28-bde1-18e391ca8b7b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:53.675833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f045a48-42b3-448e-8d02-fc1dc58970b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:53.676457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f045a48-42b3-448e-8d02-fc1dc58970b4 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:53.676738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f045a48-42b3-448e-8d02-fc1dc58970b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:53.677011 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f045a48-42b3-448e-8d02-fc1dc58970b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:53.684786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f045a48-42b3-448e-8d02-fc1dc58970b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:53.686410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f045a48-42b3-448e-8d02-fc1dc58970b4 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:53.695463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 722/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:54.610857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60df407-5f15-40ff-adb3-971e684d8070 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:54.611419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60df407-5f15-40ff-adb3-971e684d8070 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:54.611517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60df407-5f15-40ff-adb3-971e684d8070 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:54.612891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:54.617700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f7bae-bd8f-4f23-aa21-9d88ac20b266 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:54.618114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f7bae-bd8f-4f23-aa21-9d88ac20b266 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:54.618268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f7bae-bd8f-4f23-aa21-9d88ac20b266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:54.636920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-829f7bae-bd8f-4f23-aa21-9d88ac20b266 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:54.638126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-829f7bae-bd8f-4f23-aa21-9d88ac20b266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:54.645758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:54.793492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60df407-5f15-40ff-adb3-971e684d8070 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:54.807233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60df407-5f15-40ff-adb3-971e684d8070 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:54.813056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c1f7b-a6fd-420c-8d13-900829b0012d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:54.813670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c1f7b-a6fd-420c-8d13-900829b0012d service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:54.813946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c1f7b-a6fd-420c-8d13-900829b0012d service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:54.814246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c1f7b-a6fd-420c-8d13-900829b0012d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:54.821943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c1f7b-a6fd-420c-8d13-900829b0012d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:54.823531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c1f7b-a6fd-420c-8d13-900829b0012d service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:54.832455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 705/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:55.787474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4bd5-84b0-484a-bce0-cef47f257c1f None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:55.788095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4bd5-84b0-484a-bce0-cef47f257c1f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:55.788095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c4bd5-84b0-484a-bce0-cef47f257c1f None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:55.789377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:55.794407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f65344-a546-461a-ae41-3226981add89 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:55.794834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f65344-a546-461a-ae41-3226981add89 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:55.794958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f65344-a546-461a-ae41-3226981add89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:55.812628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-80f65344-a546-461a-ae41-3226981add89 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:55.813793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-80f65344-a546-461a-ae41-3226981add89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:55.821342 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:55.970168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c4bd5-84b0-484a-bce0-cef47f257c1f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:55.984502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c4bd5-84b0-484a-bce0-cef47f257c1f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:55.989729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c0093-d002-4d07-8dc9-aca590c6528f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:55.990392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c0093-d002-4d07-8dc9-aca590c6528f service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:55.990671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c0093-d002-4d07-8dc9-aca590c6528f service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:55.990943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c0093-d002-4d07-8dc9-aca590c6528f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:55.999435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c0093-d002-4d07-8dc9-aca590c6528f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:56.001082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c0093-d002-4d07-8dc9-aca590c6528f service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:56.010383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 725/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:56.938692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c32208-9b05-43ac-81ce-3922dc034193 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:56.939276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c32208-9b05-43ac-81ce-3922dc034193 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:56.939388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c32208-9b05-43ac-81ce-3922dc034193 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:56.940747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:56.945696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a794779-53dd-4e24-8ce9-bc3734a782d2 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:56.946136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a794779-53dd-4e24-8ce9-bc3734a782d2 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:56.946355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a794779-53dd-4e24-8ce9-bc3734a782d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:56.964612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7a794779-53dd-4e24-8ce9-bc3734a782d2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:56.965836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7a794779-53dd-4e24-8ce9-bc3734a782d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:56.973619 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:57.121270 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c32208-9b05-43ac-81ce-3922dc034193 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:57.135093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c32208-9b05-43ac-81ce-3922dc034193 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:57.140855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbf50b-d1ea-4cb6-a3c4-adb8cdee5ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:57.141478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbf50b-d1ea-4cb6-a3c4-adb8cdee5ce8 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:57.141761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbf50b-d1ea-4cb6-a3c4-adb8cdee5ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:57.142031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbf50b-d1ea-4cb6-a3c4-adb8cdee5ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:57.149737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbf50b-d1ea-4cb6-a3c4-adb8cdee5ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:57.151365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbf50b-d1ea-4cb6-a3c4-adb8cdee5ce8 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:57.160832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 708/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:58.078725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840f78-122b-4330-8fa0-dc774410fc2e None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:58.079281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840f78-122b-4330-8fa0-dc774410fc2e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:58.079281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840f78-122b-4330-8fa0-dc774410fc2e None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:58.080679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:58.085689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e54c78-dc3e-4409-b390-6993fa7aaac2 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:58.086112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e54c78-dc3e-4409-b390-6993fa7aaac2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:58.086280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e54c78-dc3e-4409-b390-6993fa7aaac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:58.104640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-46e54c78-dc3e-4409-b390-6993fa7aaac2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:58.106386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-46e54c78-dc3e-4409-b390-6993fa7aaac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:58.118280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:58.265749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840f78-122b-4330-8fa0-dc774410fc2e None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:58.280437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840f78-122b-4330-8fa0-dc774410fc2e None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:58.285794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ab051-7cc2-4790-ad4f-cb465ab5b9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:58.286450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ab051-7cc2-4790-ad4f-cb465ab5b9ec service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:58.286729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ab051-7cc2-4790-ad4f-cb465ab5b9ec service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:58.286998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ab051-7cc2-4790-ad4f-cb465ab5b9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:58.294865 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ab051-7cc2-4790-ad4f-cb465ab5b9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:58.296421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ab051-7cc2-4790-ad4f-cb465ab5b9ec service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:58.305469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 728/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:07:59.253317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf517bd-78bf-4fb9-885c-03b4900cd102 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:59.253826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf517bd-78bf-4fb9-885c-03b4900cd102 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:59.253826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf517bd-78bf-4fb9-885c-03b4900cd102 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:59.255220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:07:59.260040 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387a75-ff8d-4d4c-bacb-9dd57be186e4 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:59.260491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387a75-ff8d-4d4c-bacb-9dd57be186e4 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:59.260607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387a75-ff8d-4d4c-bacb-9dd57be186e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:59.277880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8b387a75-ff8d-4d4c-bacb-9dd57be186e4 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:07:59.279105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8b387a75-ff8d-4d4c-bacb-9dd57be186e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:07:59.287027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:07:59.438073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf517bd-78bf-4fb9-885c-03b4900cd102 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:07:59.451947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf517bd-78bf-4fb9-885c-03b4900cd102 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:07:59.457218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858143fa-c6fe-4769-8172-1aa762fd3dd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:07:59.457842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858143fa-c6fe-4769-8172-1aa762fd3dd7 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:07:59.458157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858143fa-c6fe-4769-8172-1aa762fd3dd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:07:59.458437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858143fa-c6fe-4769-8172-1aa762fd3dd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:07:59.466754 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858143fa-c6fe-4769-8172-1aa762fd3dd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:07:59.468316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858143fa-c6fe-4769-8172-1aa762fd3dd7 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:07:59.477567 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 711/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:01.562759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6d19-dca4-48eb-a9c8-144a13b51341 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:01.563407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6d19-dca4-48eb-a9c8-144a13b51341 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:01.563407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6d19-dca4-48eb-a9c8-144a13b51341 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:01.564771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:01.570198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e70d-c78f-4a85-b009-75bfc1fdf6b1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:01.570652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e70d-c78f-4a85-b009-75bfc1fdf6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:01.570760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e70d-c78f-4a85-b009-75bfc1fdf6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:01.587761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b5d6e70d-c78f-4a85-b009-75bfc1fdf6b1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:01.588927 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b5d6e70d-c78f-4a85-b009-75bfc1fdf6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:01.596618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:08:01.636122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6d19-dca4-48eb-a9c8-144a13b51341 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:01.646595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6d19-dca4-48eb-a9c8-144a13b51341 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:01.650090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e86962-70c3-4d28-9ac3-94a26934b33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:01.651231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e86962-70c3-4d28-9ac3-94a26934b33a service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:01.651538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e86962-70c3-4d28-9ac3-94a26934b33a service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:01.651818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e86962-70c3-4d28-9ac3-94a26934b33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:01.660388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e86962-70c3-4d28-9ac3-94a26934b33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:01.661815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e86962-70c3-4d28-9ac3-94a26934b33a service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:01.671493 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 731/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:04.019119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68fab4-f431-4005-ab14-f023ae7ba954 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:04.019647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68fab4-f431-4005-ab14-f023ae7ba954 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:04.019647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68fab4-f431-4005-ab14-f023ae7ba954 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:04.021035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:04.026340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2132802-b53d-4009-8359-b30be244a2c9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:04.026751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2132802-b53d-4009-8359-b30be244a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:04.026886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2132802-b53d-4009-8359-b30be244a2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:04.044068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c2132802-b53d-4009-8359-b30be244a2c9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:04.045233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c2132802-b53d-4009-8359-b30be244a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:04.052765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:04.090364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68fab4-f431-4005-ab14-f023ae7ba954 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:04.101035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb68fab4-f431-4005-ab14-f023ae7ba954 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:04.104843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e227544-df66-4c49-a912-cde104b404ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:04.105478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e227544-df66-4c49-a912-cde104b404ab service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:04.105758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e227544-df66-4c49-a912-cde104b404ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:04.106030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e227544-df66-4c49-a912-cde104b404ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:04.114719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e227544-df66-4c49-a912-cde104b404ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:04.116135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e227544-df66-4c49-a912-cde104b404ab service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:04.125600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 714/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:06.717439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5da4-1533-4f9f-9c08-d63456e5040b None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:06.724198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5da4-1533-4f9f-9c08-d63456e5040b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:06.724198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5da4-1533-4f9f-9c08-d63456e5040b None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:06.724198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:06.725156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50efad-83a3-40b9-86ba-968891035176 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:06.725546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50efad-83a3-40b9-86ba-968891035176 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:06.725704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50efad-83a3-40b9-86ba-968891035176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:06.743697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0c50efad-83a3-40b9-86ba-968891035176 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:06.745167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0c50efad-83a3-40b9-86ba-968891035176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:06.752849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:06.791140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5da4-1533-4f9f-9c08-d63456e5040b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:06.801669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5da4-1533-4f9f-9c08-d63456e5040b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:06.805195 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486aab1-979a-435e-8b23-8dc8004b8b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:06.805810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486aab1-979a-435e-8b23-8dc8004b8b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:06.806108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486aab1-979a-435e-8b23-8dc8004b8b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:06.806383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486aab1-979a-435e-8b23-8dc8004b8b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:06.814835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486aab1-979a-435e-8b23-8dc8004b8b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:06.816273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486aab1-979a-435e-8b23-8dc8004b8b99 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:06.825800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 734/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:09.140114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd417a41-7515-4ce4-991d-9a3e244bdde4 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:09.140660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd417a41-7515-4ce4-991d-9a3e244bdde4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:09.140660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd417a41-7515-4ce4-991d-9a3e244bdde4 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:09.142157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:09.147547 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3384975-1335-4df9-9b48-4e3fda04c58c None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:09.147964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3384975-1335-4df9-9b48-4e3fda04c58c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:09.148360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3384975-1335-4df9-9b48-4e3fda04c58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:09.167368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e3384975-1335-4df9-9b48-4e3fda04c58c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:09.168544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e3384975-1335-4df9-9b48-4e3fda04c58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:09.176278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:09.214665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd417a41-7515-4ce4-991d-9a3e244bdde4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:09.225408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd417a41-7515-4ce4-991d-9a3e244bdde4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:09.229593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9614298-3911-4a56-982f-6676066d340d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:09.230261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614298-3911-4a56-982f-6676066d340d service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:09.230545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614298-3911-4a56-982f-6676066d340d service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:09.230820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614298-3911-4a56-982f-6676066d340d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:09.239422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9614298-3911-4a56-982f-6676066d340d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:09.240845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9614298-3911-4a56-982f-6676066d340d service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:09.250015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 717/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:11.486556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aa2d7-b6df-4ae0-9118-3bae8dc51d80 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:11.487064 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aa2d7-b6df-4ae0-9118-3bae8dc51d80 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:11.487064 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aa2d7-b6df-4ae0-9118-3bae8dc51d80 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:11.488398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:11.493695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc5a1-0c0b-4245-baa2-7c66b87634a0 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:11.494149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc5a1-0c0b-4245-baa2-7c66b87634a0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:11.494284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc5a1-0c0b-4245-baa2-7c66b87634a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:11.512288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8cbdc5a1-0c0b-4245-baa2-7c66b87634a0 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:11.513486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8cbdc5a1-0c0b-4245-baa2-7c66b87634a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:11.521492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:11.559498 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aa2d7-b6df-4ae0-9118-3bae8dc51d80 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:11.569746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aa2d7-b6df-4ae0-9118-3bae8dc51d80 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:11.573216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3dfa9-c702-45dd-b2af-550840740c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:11.573838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3dfa9-c702-45dd-b2af-550840740c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:11.574147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3dfa9-c702-45dd-b2af-550840740c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:11.574423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3dfa9-c702-45dd-b2af-550840740c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:11.582954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3dfa9-c702-45dd-b2af-550840740c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:11.584361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3dfa9-c702-45dd-b2af-550840740c06 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:11.593867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 737/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:13.904506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ed3c5-4519-40b4-b3f9-95450f90bd4e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:13.905085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ed3c5-4519-40b4-b3f9-95450f90bd4e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:13.905085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ed3c5-4519-40b4-b3f9-95450f90bd4e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:13.906453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:13.911906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63955d-c14d-4314-96f2-4ffec4753548 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:13.912310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63955d-c14d-4314-96f2-4ffec4753548 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:13.912459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63955d-c14d-4314-96f2-4ffec4753548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:13.929631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ae63955d-c14d-4314-96f2-4ffec4753548 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:13.931330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ae63955d-c14d-4314-96f2-4ffec4753548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:13.938944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:08:13.978509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ed3c5-4519-40b4-b3f9-95450f90bd4e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:13.988838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ed3c5-4519-40b4-b3f9-95450f90bd4e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:13.992303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbad91e-b5f4-4136-8f0a-465321485fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:13.992927 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbad91e-b5f4-4136-8f0a-465321485fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:13.993207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbad91e-b5f4-4136-8f0a-465321485fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:13.993477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbad91e-b5f4-4136-8f0a-465321485fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:14.002636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbad91e-b5f4-4136-8f0a-465321485fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:14.004066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbad91e-b5f4-4136-8f0a-465321485fc0 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:14.013896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 720/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:16.236615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6c301-48e7-4096-8d40-cb3a7723314f None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:16.237159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6c301-48e7-4096-8d40-cb3a7723314f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:16.237159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6c301-48e7-4096-8d40-cb3a7723314f None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:16.238592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:16.243932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e6b8b-1eb4-428a-a76e-2389a7b8753c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:16.244351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e6b8b-1eb4-428a-a76e-2389a7b8753c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:16.244461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e6b8b-1eb4-428a-a76e-2389a7b8753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:16.262150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ff1e6b8b-1eb4-428a-a76e-2389a7b8753c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:16.263316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ff1e6b8b-1eb4-428a-a76e-2389a7b8753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:16.270902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:16.308350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6c301-48e7-4096-8d40-cb3a7723314f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:16.318670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6c301-48e7-4096-8d40-cb3a7723314f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:16.322030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a72df-0383-4c3a-8947-43c1a174b69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:16.322678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a72df-0383-4c3a-8947-43c1a174b69b service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:16.322954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a72df-0383-4c3a-8947-43c1a174b69b service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:16.323223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a72df-0383-4c3a-8947-43c1a174b69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:16.331686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a72df-0383-4c3a-8947-43c1a174b69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:16.333032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a72df-0383-4c3a-8947-43c1a174b69b service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:16.342417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 740/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:18.585282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cea93-fbe4-44ae-a871-11a406bd82a3 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:18.586362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cea93-fbe4-44ae-a871-11a406bd82a3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:18.586362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cea93-fbe4-44ae-a871-11a406bd82a3 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:18.587718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:18.593251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eea441-78c1-48c4-a6c0-c44094256bd3 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:18.593701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eea441-78c1-48c4-a6c0-c44094256bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:18.593809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eea441-78c1-48c4-a6c0-c44094256bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:18.611813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-45eea441-78c1-48c4-a6c0-c44094256bd3 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:18.613041 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-45eea441-78c1-48c4-a6c0-c44094256bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:18.620873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:18.657920 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cea93-fbe4-44ae-a871-11a406bd82a3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:18.668750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cea93-fbe4-44ae-a871-11a406bd82a3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:18.672169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed127d-0c3a-4a03-9311-9c1da6bffd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:18.672787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed127d-0c3a-4a03-9311-9c1da6bffd94 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:18.673062 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed127d-0c3a-4a03-9311-9c1da6bffd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:18.673328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed127d-0c3a-4a03-9311-9c1da6bffd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:18.681739 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed127d-0c3a-4a03-9311-9c1da6bffd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:18.683188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed127d-0c3a-4a03-9311-9c1da6bffd94 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:18.692068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 723/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:20.904306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5f9c7-65c3-4994-a79e-6eb18f565256 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:20.904903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5f9c7-65c3-4994-a79e-6eb18f565256 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:20.904903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5f9c7-65c3-4994-a79e-6eb18f565256 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:20.906265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:20.911426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7196-08d1-4b05-87ff-a3688113a04c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:20.911830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7196-08d1-4b05-87ff-a3688113a04c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:20.911981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7196-08d1-4b05-87ff-a3688113a04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:20.928942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3f8a7196-08d1-4b05-87ff-a3688113a04c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:20.930679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3f8a7196-08d1-4b05-87ff-a3688113a04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:20.938341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:20.974928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5f9c7-65c3-4994-a79e-6eb18f565256 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:20.985467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5f9c7-65c3-4994-a79e-6eb18f565256 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:20.989022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab95193-ffff-4bc2-b625-3cd53f751d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:20.989651 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab95193-ffff-4bc2-b625-3cd53f751d73 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:20.989928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab95193-ffff-4bc2-b625-3cd53f751d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:20.990225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab95193-ffff-4bc2-b625-3cd53f751d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:20.999314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab95193-ffff-4bc2-b625-3cd53f751d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:21.000739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab95193-ffff-4bc2-b625-3cd53f751d73 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:21.010609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 743/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:23.216405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790fb1c-6c14-41ee-982a-f6661bd2c059 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:23.216937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790fb1c-6c14-41ee-982a-f6661bd2c059 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:23.216937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790fb1c-6c14-41ee-982a-f6661bd2c059 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:23.218366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:23.227729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33ef6-0edd-49a4-bdc6-007a92de0962 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:23.227729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33ef6-0edd-49a4-bdc6-007a92de0962 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:23.227729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33ef6-0edd-49a4-bdc6-007a92de0962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:23.241917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7fd33ef6-0edd-49a4-bdc6-007a92de0962 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:23.243110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7fd33ef6-0edd-49a4-bdc6-007a92de0962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:23.250678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:23.287190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790fb1c-6c14-41ee-982a-f6661bd2c059 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:23.297706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790fb1c-6c14-41ee-982a-f6661bd2c059 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:23.301130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25125195-cf26-491e-9817-798ced2f94c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:23.301802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25125195-cf26-491e-9817-798ced2f94c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:23.302099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25125195-cf26-491e-9817-798ced2f94c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:23.302376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25125195-cf26-491e-9817-798ced2f94c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:23.311559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25125195-cf26-491e-9817-798ced2f94c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:23.312997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25125195-cf26-491e-9817-798ced2f94c9 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:23.322643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 726/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:56.462657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a4fc3-32e4-4453-a91a-2edb3e7ad27b None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:56.463215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a4fc3-32e4-4453-a91a-2edb3e7ad27b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:56.463215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a4fc3-32e4-4453-a91a-2edb3e7ad27b None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:56.464531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 745/1471] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:56.469951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10f1d4-005e-442c-a208-c0de22ba9907 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:56.470416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10f1d4-005e-442c-a208-c0de22ba9907 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:56.470545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10f1d4-005e-442c-a208-c0de22ba9907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:56.488298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-dd10f1d4-005e-442c-a208-c0de22ba9907 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:56.489482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-dd10f1d4-005e-442c-a208-c0de22ba9907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:56.497291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 727/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:56.544077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b41f-8f78-40d8-8258-7348fcabb1d9 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:56.544362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b41f-8f78-40d8-8258-7348fcabb1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:56.544662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b41f-8f78-40d8-8258-7348fcabb1d9 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:56.546071 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 746/1473] 10.222.0.44 () {54 vars in 962 bytes} [Mon May 16 15:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:56.550814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f721-0664-4e64-b3de-4670f8b566ba None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:56.551105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f721-0664-4e64-b3de-4670f8b566ba None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:56.551381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f721-0664-4e64-b3de-4670f8b566ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:56.569135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0842f721-0664-4e64-b3de-4670f8b566ba None None] MFA Rules not processed for user `d9237b353da546989b399ee9702d1bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:56.570339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0842f721-0664-4e64-b3de-4670f8b566ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:56.576631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 728/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Mon May 16 15:08:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:56.583630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b41f-8f78-40d8-8258-7348fcabb1d9 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:56.594119 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b41f-8f78-40d8-8258-7348fcabb1d9 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:56.597983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bec777-6d71-4c16-ac04-a7620a922259 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9237b353da546989b399ee9702d1bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:56.598620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec777-6d71-4c16-ac04-a7620a922259 service glance] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:56.598896 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec777-6d71-4c16-ac04-a7620a922259 service glance] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:56.599164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec777-6d71-4c16-ac04-a7620a922259 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:56.607986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bec777-6d71-4c16-ac04-a7620a922259 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:56.609390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bec777-6d71-4c16-ac04-a7620a922259 service glance] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:56.618995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 747/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:08:58.908553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edac974-e250-4d17-9626-18199ac4317b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:58.908999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edac974-e250-4d17-9626-18199ac4317b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:58.909168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edac974-e250-4d17-9626-18199ac4317b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:58.910580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 729/1476] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:08:58.915880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6bdc-9c3f-4817-8505-195c7a581081 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:58.921368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6bdc-9c3f-4817-8505-195c7a581081 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:58.921368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be6bdc-9c3f-4817-8505-195c7a581081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:58.933278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-b6be6bdc-9c3f-4817-8505-195c7a581081 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:08:58.934477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b6be6bdc-9c3f-4817-8505-195c7a581081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:08:58.942596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 748/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:08:58.966557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edac974-e250-4d17-9626-18199ac4317b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:08:58.979118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edac974-e250-4d17-9626-18199ac4317b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:08:58.983488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219a875-e1f0-4269-b1c0-f073958b26e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:08:58.984132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219a875-e1f0-4269-b1c0-f073958b26e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:08:58.984411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219a875-e1f0-4269-b1c0-f073958b26e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:08:58.984683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219a875-e1f0-4269-b1c0-f073958b26e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:08:58.985401 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219a875-e1f0-4269-b1c0-f073958b26e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:08:58.987215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-0219a875-e1f0-4269-b1c0-f073958b26e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:08:58.987215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: warnings.warn(msg) May 16 15:08:58.987215 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: May 16 15:08:58.988337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219a875-e1f0-4269-b1c0-f073958b26e9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:08:59.008473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 730/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Mon May 16 15:08:58 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:09:01.239533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d206a9b-1a35-4700-b8e2-b0bde2045dfa None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:01.240061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d206a9b-1a35-4700-b8e2-b0bde2045dfa None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:01.240061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d206a9b-1a35-4700-b8e2-b0bde2045dfa None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:01.241462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 749/1479] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:09:01.246598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684472a-bdd3-4a5b-9bcd-7e8c3c566b5d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:01.247016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684472a-bdd3-4a5b-9bcd-7e8c3c566b5d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:01.247179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684472a-bdd3-4a5b-9bcd-7e8c3c566b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:01.264316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3684472a-bdd3-4a5b-9bcd-7e8c3c566b5d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:09:01.265487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3684472a-bdd3-4a5b-9bcd-7e8c3c566b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:09:01.273282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 731/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:09:01.315145 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d206a9b-1a35-4700-b8e2-b0bde2045dfa None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:09:01.328843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d206a9b-1a35-4700-b8e2-b0bde2045dfa None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:09:01.334702 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95b925-21a0-4b35-a80c-d4b0e40602ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:09:01.335255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95b925-21a0-4b35-a80c-d4b0e40602ae service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:01.335534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95b925-21a0-4b35-a80c-d4b0e40602ae service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:01.335805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95b925-21a0-4b35-a80c-d4b0e40602ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:01.343839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95b925-21a0-4b35-a80c-d4b0e40602ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:09:01.345388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95b925-21a0-4b35-a80c-d4b0e40602ae service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:09:01.354922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 750/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:09:03.716455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbd015-3c7a-42b4-b98b-2fb605bd5ef6 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:03.716983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbd015-3c7a-42b4-b98b-2fb605bd5ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:03.716983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbd015-3c7a-42b4-b98b-2fb605bd5ef6 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:03.718606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 732/1482] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:09:03.723747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c915-ac06-4a66-a286-6d676411ecc1 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:03.724147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c915-ac06-4a66-a286-6d676411ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:03.724294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c915-ac06-4a66-a286-6d676411ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:03.741684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-b529c915-ac06-4a66-a286-6d676411ecc1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:09:03.742897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b529c915-ac06-4a66-a286-6d676411ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:09:03.750530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 751/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:09:03.785919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbd015-3c7a-42b4-b98b-2fb605bd5ef6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:09:03.796265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbd015-3c7a-42b4-b98b-2fb605bd5ef6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:09:03.800451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb5413-64dc-490c-aef6-7148f38df77e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:09:03.801083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5413-64dc-490c-aef6-7148f38df77e service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:03.801361 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5413-64dc-490c-aef6-7148f38df77e service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:03.802122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb5413-64dc-490c-aef6-7148f38df77e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:03.811129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb5413-64dc-490c-aef6-7148f38df77e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:09:03.812545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb5413-64dc-490c-aef6-7148f38df77e service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:09:03.822114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 733/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:09:06.059730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac0f4-75c3-4b4a-a93b-d8afed8675f1 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:06.060266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac0f4-75c3-4b4a-a93b-d8afed8675f1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:06.060266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac0f4-75c3-4b4a-a93b-d8afed8675f1 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:06.061654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 752/1485] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:09:06.067032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bdf97-bc2d-42c8-a8d3-be5a0c2e056e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:06.067484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bdf97-bc2d-42c8-a8d3-be5a0c2e056e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:06.067593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bdf97-bc2d-42c8-a8d3-be5a0c2e056e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:06.087536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-323bdf97-bc2d-42c8-a8d3-be5a0c2e056e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:09:06.088965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-323bdf97-bc2d-42c8-a8d3-be5a0c2e056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:09:06.098116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 734/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:09:06.135322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac0f4-75c3-4b4a-a93b-d8afed8675f1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:09:06.146178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac0f4-75c3-4b4a-a93b-d8afed8675f1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:09:06.149604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1a306-25d9-4895-ba55-665445cf272c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:09:06.150268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1a306-25d9-4895-ba55-665445cf272c service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:06.150549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1a306-25d9-4895-ba55-665445cf272c service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:06.150823 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1a306-25d9-4895-ba55-665445cf272c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:06.159962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1a306-25d9-4895-ba55-665445cf272c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:09:06.161375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1a306-25d9-4895-ba55-665445cf272c service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:09:06.170351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 753/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:09:08.534644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4073d7-8ba5-4a09-b386-1484ea9a9dc8 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:08.535264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4073d7-8ba5-4a09-b386-1484ea9a9dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:08.535264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4073d7-8ba5-4a09-b386-1484ea9a9dc8 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:08.536521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 735/1488] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:09:08.541795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877be69-df89-46d3-a273-15fa9447cd9f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:08.543188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877be69-df89-46d3-a273-15fa9447cd9f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:08.543188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877be69-df89-46d3-a273-15fa9447cd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:08.559570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3877be69-df89-46d3-a273-15fa9447cd9f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:09:08.560750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3877be69-df89-46d3-a273-15fa9447cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:09:08.569204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 754/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:09:08.609632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4073d7-8ba5-4a09-b386-1484ea9a9dc8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:09:08.620286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4073d7-8ba5-4a09-b386-1484ea9a9dc8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:09:08.623695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee5271-7677-43ce-aade-a7843aef98c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:09:08.624313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5271-7677-43ce-aade-a7843aef98c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:08.624590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5271-7677-43ce-aade-a7843aef98c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:08.624859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5271-7677-43ce-aade-a7843aef98c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:08.633956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee5271-7677-43ce-aade-a7843aef98c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:09:08.635422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee5271-7677-43ce-aade-a7843aef98c0 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:09:08.645435 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 736/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:09:11.228519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3bad-e291-42b6-bad5-c57c9883f9af None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:11.229066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3bad-e291-42b6-bad5-c57c9883f9af None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:11.229066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3bad-e291-42b6-bad5-c57c9883f9af None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:11.230498 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 755/1491] 10.222.0.44 () {54 vars in 926 bytes} [Mon May 16 15:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:09:11.236325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106497b1-b55a-4e07-95cc-fc0bc14ed7b5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:11.236841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106497b1-b55a-4e07-95cc-fc0bc14ed7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:11.236946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106497b1-b55a-4e07-95cc-fc0bc14ed7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:11.254885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-106497b1-b55a-4e07-95cc-fc0bc14ed7b5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:09:11.256060 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-106497b1-b55a-4e07-95cc-fc0bc14ed7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:09:11.263639 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 737/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Mon May 16 15:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:09:11.302624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3bad-e291-42b6-bad5-c57c9883f9af None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:09:11.312811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3bad-e291-42b6-bad5-c57c9883f9af None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:09:11.316848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfb757-ad0c-4812-b2af-a644c42e33a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:09:11.317466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfb757-ad0c-4812-b2af-a644c42e33a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:09:11.317740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfb757-ad0c-4812-b2af-a644c42e33a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:09:11.318005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfb757-ad0c-4812-b2af-a644c42e33a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:09:11.326527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfb757-ad0c-4812-b2af-a644c42e33a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:09:11.327926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfb757-ad0c-4812-b2af-a644c42e33a3 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:09:11.336902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 756/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:11:18.014509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5629-8d65-418e-b1f1-498fd6ad0578 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.015101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5629-8d65-418e-b1f1-498fd6ad0578 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.015101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5629-8d65-418e-b1f1-498fd6ad0578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.033125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1ecd5629-8d65-418e-b1f1-498fd6ad0578 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:11:18.034334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1ecd5629-8d65-418e-b1f1-498fd6ad0578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:11:18.041997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 738/1494] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:11:18.051654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89892b22-5c9d-46f3-9920-796328c441bf None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.052168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89892b22-5c9d-46f3-9920-796328c441bf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.052273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89892b22-5c9d-46f3-9920-796328c441bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.069423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-89892b22-5c9d-46f3-9920-796328c441bf None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:11:18.070630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-89892b22-5c9d-46f3-9920-796328c441bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:11:18.078416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 757/1495] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:11:18.083049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5629-8d65-418e-b1f1-498fd6ad0578 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:18.092536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5629-8d65-418e-b1f1-498fd6ad0578 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:18.097423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:18.098078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.098385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.098643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.099378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:11:18.099679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:18.100683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:11:18.100683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: warnings.warn(msg) May 16 15:11:18.100683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: May 16 15:11:18.101551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:18.113109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 739/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:11:18.121078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89892b22-5c9d-46f3-9920-796328c441bf None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:18.129870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89892b22-5c9d-46f3-9920-796328c441bf None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:18.134373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24c49f-436d-416f-b123-2a176f752fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:18.135008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24c49f-436d-416f-b123-2a176f752fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.135289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24c49f-436d-416f-b123-2a176f752fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.135563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24c49f-436d-416f-b123-2a176f752fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.136242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24c49f-436d-416f-b123-2a176f752fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:18.137972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WARNING py.warnings [None req-5e24c49f-436d-416f-b123-2a176f752fe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:11:18.137972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: warnings.warn(msg) May 16 15:11:18.137972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: May 16 15:11:18.139176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24c49f-436d-416f-b123-2a176f752fe3 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:18.241654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 758/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:11:18 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:11:18.248732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:18.258283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299a7f9-3e2b-4c79-87ce-4af07fefac79 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:18.310995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fd095-87cc-4664-acb8-f60535806e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:18.311651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fd095-87cc-4664-acb8-f60535806e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.311937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fd095-87cc-4664-acb8-f60535806e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.312212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fd095-87cc-4664-acb8-f60535806e86 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.312880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fd095-87cc-4664-acb8-f60535806e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:18.313901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-819fd095-87cc-4664-acb8-f60535806e86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:11:18.313901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: warnings.warn(msg) May 16 15:11:18.313901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: May 16 15:11:18.315130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fd095-87cc-4664-acb8-f60535806e86 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:18.426309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 740/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:11:18 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:11:18.430441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24c49f-436d-416f-b123-2a176f752fe3 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:18.440349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24c49f-436d-416f-b123-2a176f752fe3 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:18.444934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7adae-793e-4009-ba87-cfcb42f0bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:18.445579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7adae-793e-4009-ba87-cfcb42f0bddd admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.445859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7adae-793e-4009-ba87-cfcb42f0bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.446159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7adae-793e-4009-ba87-cfcb42f0bddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.446886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7adae-793e-4009-ba87-cfcb42f0bddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:18.447889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WARNING py.warnings [None req-9ea7adae-793e-4009-ba87-cfcb42f0bddd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:11:18.447889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: warnings.warn(msg) May 16 15:11:18.447889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: May 16 15:11:18.448754 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7adae-793e-4009-ba87-cfcb42f0bddd admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:18.461622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 759/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:11:18.465377 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fd095-87cc-4664-acb8-f60535806e86 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:18.475744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fd095-87cc-4664-acb8-f60535806e86 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:18.480426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e60494-e029-4bab-9d04-7c284d9adf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:18.481074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60494-e029-4bab-9d04-7c284d9adf65 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.481357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60494-e029-4bab-9d04-7c284d9adf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.481632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60494-e029-4bab-9d04-7c284d9adf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.482378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e60494-e029-4bab-9d04-7c284d9adf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:18.483392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-c0e60494-e029-4bab-9d04-7c284d9adf65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:11:18.483392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: warnings.warn(msg) May 16 15:11:18.483392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: May 16 15:11:18.484279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e60494-e029-4bab-9d04-7c284d9adf65 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:18.497122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 741/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:11:18.501072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7adae-793e-4009-ba87-cfcb42f0bddd admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:18.510487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7adae-793e-4009-ba87-cfcb42f0bddd admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:18.514945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6c7f-705d-429a-9ff8-b272958cbb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:18.515810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6c7f-705d-429a-9ff8-b272958cbb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.516082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6c7f-705d-429a-9ff8-b272958cbb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.516350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6c7f-705d-429a-9ff8-b272958cbb8c admin admin] PATH_INFO: `/v3/projects/490f67601554436eaf8824b0253f750a/users/113d7ebdb96f4e18ac8fb3b350d10525/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.530696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6c7f-705d-429a-9ff8-b272958cbb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=490f67601554436eaf8824b0253f750a, user_id=113d7ebdb96f4e18ac8fb3b350d10525, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:18.531719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WARNING py.warnings [None req-6f2b6c7f-705d-429a-9ff8-b272958cbb8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:11:18.531719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: warnings.warn(msg) May 16 15:11:18.531719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: May 16 15:11:18.534316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6c7f-705d-429a-9ff8-b272958cbb8c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:18.619751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 760/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:11:18 2022] PUT /identity/v3/projects/490f67601554436eaf8824b0253f750a/users/113d7ebdb96f4e18ac8fb3b350d10525/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:11:18.631370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667538ef-923a-4388-b22a-c148f086a765 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.631665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667538ef-923a-4388-b22a-c148f086a765 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.631946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667538ef-923a-4388-b22a-c148f086a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.658284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-667538ef-923a-4388-b22a-c148f086a765 None None] MFA Rules not processed for user `113d7ebdb96f4e18ac8fb3b350d10525`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:11:18.659456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-667538ef-923a-4388-b22a-c148f086a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:11:18.718790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 742/1502] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:11:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:11:18.732542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b1b80-01d5-4b55-a43d-7c29aba3b41f None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.732835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b1b80-01d5-4b55-a43d-7c29aba3b41f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.733118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b1b80-01d5-4b55-a43d-7c29aba3b41f None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.734566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 761/1503] 10.222.0.44 () {54 vars in 963 bytes} [Mon May 16 15:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:11:18.740198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bfbdd-1262-4506-902d-9fd57c47bff3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.740481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bfbdd-1262-4506-902d-9fd57c47bff3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.740751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bfbdd-1262-4506-902d-9fd57c47bff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.758162 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-012bfbdd-1262-4506-902d-9fd57c47bff3 None None] MFA Rules not processed for user `55591aa3b6324ce99d1529beb8f6de2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:11:18.759326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-012bfbdd-1262-4506-902d-9fd57c47bff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:11:18.806623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 743/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Mon May 16 15:11:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:11:18.813975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b1b80-01d5-4b55-a43d-7c29aba3b41f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:18.824300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b1b80-01d5-4b55-a43d-7c29aba3b41f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:18.827816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5000492-fe92-4b5e-99e1-78e5ba4341c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:18.828439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5000492-fe92-4b5e-99e1-78e5ba4341c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.828721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5000492-fe92-4b5e-99e1-78e5ba4341c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.828995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5000492-fe92-4b5e-99e1-78e5ba4341c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.837178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5000492-fe92-4b5e-99e1-78e5ba4341c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:18.838678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5000492-fe92-4b5e-99e1-78e5ba4341c0 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:18.848183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 762/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:11:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:11:18.891375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b450-7599-4335-bbb9-f998dc5511c0 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.891662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b450-7599-4335-bbb9-f998dc5511c0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.891937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849b450-7599-4335-bbb9-f998dc5511c0 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.893257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 744/1506] 10.222.0.44 () {52 vars in 829 bytes} [Mon May 16 15:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:11:18.896803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5000492-fe92-4b5e-99e1-78e5ba4341c0 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:18.954578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5000492-fe92-4b5e-99e1-78e5ba4341c0 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:18.959044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:18.960153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:18.960434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:18.960705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] PATH_INFO: `/v3/users/113d7ebdb96f4e18ac8fb3b350d10525` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:18.961871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] RBAC: Authorizing `identity:delete_user(user_id=113d7ebdb96f4e18ac8fb3b350d10525)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:18.962922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WARNING py.warnings [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:11:18.962922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: warnings.warn(msg) May 16 15:11:18.962922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: May 16 15:11:18.964110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:19.184817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113d7ebdb96f4e18ac8fb3b350d10525'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:19.185476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113d7ebdb96f4e18ac8fb3b350d10525'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:19.186079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113d7ebdb96f4e18ac8fb3b350d10525'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:19.203294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113d7ebdb96f4e18ac8fb3b350d10525'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:19.215738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113d7ebdb96f4e18ac8fb3b350d10525'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:19.299094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 763/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:11:18 2022] DELETE /identity/v3/users/113d7ebdb96f4e18ac8fb3b350d10525 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:11:19.303560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b036ce-6e6f-4c11-96b0-5d174657d3eb None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:19.304010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b036ce-6e6f-4c11-96b0-5d174657d3eb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:19.305759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b036ce-6e6f-4c11-96b0-5d174657d3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:19.320970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-31b036ce-6e6f-4c11-96b0-5d174657d3eb None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:11:19.322169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-31b036ce-6e6f-4c11-96b0-5d174657d3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:11:19.377645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 745/1508] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:11:19.387106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:19.388500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:11:19.441923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c6e04-85bd-4d9e-a66f-2fdf974cedee admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:19.445398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bded2-9963-463e-a322-99fa027d9b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:19.446029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bded2-9963-463e-a322-99fa027d9b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:19.446339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bded2-9963-463e-a322-99fa027d9b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:19.446612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bded2-9963-463e-a322-99fa027d9b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:19.455627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bded2-9963-463e-a322-99fa027d9b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:19.457042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bded2-9963-463e-a322-99fa027d9b03 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:19.466244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 764/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:11:19.887791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b036ce-6e6f-4c11-96b0-5d174657d3eb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:11:19.889374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-31b036ce-6e6f-4c11-96b0-5d174657d3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:11:19.900894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b036ce-6e6f-4c11-96b0-5d174657d3eb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:11:19.905633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:11:19.906661 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:11:19.906948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:11:19.907230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] PATH_INFO: `/v3/projects/490f67601554436eaf8824b0253f750a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:11:19.908392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=490f67601554436eaf8824b0253f750a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:11:19.909409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:11:19.909409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: warnings.warn(msg) May 16 15:11:19.909409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: May 16 15:11:19.910609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:11:20.029484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490f67601554436eaf8824b0253f750a', 'request_id': 'req-2dd4f8f5-4d69-490e-ab1b-7577e509a403'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:20.042293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490f67601554436eaf8824b0253f750a', 'request_id': 'req-2dd4f8f5-4d69-490e-ab1b-7577e509a403'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:20.048435 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490f67601554436eaf8824b0253f750a', 'request_id': 'req-2dd4f8f5-4d69-490e-ab1b-7577e509a403'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:20.128318 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] The token cache is being invalidate because project 490f67601554436eaf8824b0253f750a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:11:20.128600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:20.129245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dd4f8f5-4d69-490e-ab1b-7577e509a403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:11:20.130928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 746/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:11:19 2022] DELETE /identity/v3/projects/490f67601554436eaf8824b0253f750a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:13:05.127633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175ab4-076d-4d20-8d81-8dc27ec06a0c None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:05.128173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175ab4-076d-4d20-8d81-8dc27ec06a0c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:05.128283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175ab4-076d-4d20-8d81-8dc27ec06a0c None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:05.129573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 765/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:05.134392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0813-ab1e-4519-94ff-a56a17e7cea7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:05.134821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0813-ab1e-4519-94ff-a56a17e7cea7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:05.134929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0813-ab1e-4519-94ff-a56a17e7cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:05.152649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-15ad0813-ab1e-4519-94ff-a56a17e7cea7 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:05.153833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-15ad0813-ab1e-4519-94ff-a56a17e7cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:05.208037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 747/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:13:05.373699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175ab4-076d-4d20-8d81-8dc27ec06a0c None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:05.375307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-22175ab4-076d-4d20-8d81-8dc27ec06a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:05.444171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175ab4-076d-4d20-8d81-8dc27ec06a0c None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:05.449390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda2513-570f-4a2b-9182-521349e62600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:05.450013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda2513-570f-4a2b-9182-521349e62600 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:05.450316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda2513-570f-4a2b-9182-521349e62600 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:05.450583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda2513-570f-4a2b-9182-521349e62600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:05.459228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda2513-570f-4a2b-9182-521349e62600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:05.460797 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda2513-570f-4a2b-9182-521349e62600 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:05.470548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 766/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:05.597528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f7904-a68c-4456-8749-b1df5b1a516e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:05.597820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f7904-a68c-4456-8749-b1df5b1a516e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:05.598157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f7904-a68c-4456-8749-b1df5b1a516e None None] PATH_INFO: `/v3` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:05.599501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 748/1514] 10.222.0.69 () {54 vars in 925 bytes} [Mon May 16 15:13:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:13:05.606640 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2b3f2-e4da-4d34-a8d8-3adbb61ddfb2 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:05.606937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2b3f2-e4da-4d34-a8d8-3adbb61ddfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:05.607219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2b3f2-e4da-4d34-a8d8-3adbb61ddfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:05.624881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-88e2b3f2-e4da-4d34-a8d8-3adbb61ddfb2 None None] MFA Rules not processed for user `6dfdb39ae2804b2191cea53f2a387c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:05.626036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-88e2b3f2-e4da-4d34-a8d8-3adbb61ddfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:05.689068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 767/1515] 10.222.0.69 () {58 vars in 1015 bytes} [Mon May 16 15:13:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:06.375701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc28a58-36e6-4525-814a-f9d9ba048584 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:06.376236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc28a58-36e6-4525-814a-f9d9ba048584 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:06.376236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc28a58-36e6-4525-814a-f9d9ba048584 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:06.377561 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 749/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:06.382506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529241e8-49e6-4340-9ea8-078c1684491a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:06.382929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529241e8-49e6-4340-9ea8-078c1684491a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:06.383066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529241e8-49e6-4340-9ea8-078c1684491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:06.402585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-529241e8-49e6-4340-9ea8-078c1684491a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:06.403771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-529241e8-49e6-4340-9ea8-078c1684491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:06.411481 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 768/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:06.561872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc28a58-36e6-4525-814a-f9d9ba048584 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:06.575619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc28a58-36e6-4525-814a-f9d9ba048584 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:06.581476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f43c6e-3a3e-4150-82a6-3c03d21f3981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:06.582127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f43c6e-3a3e-4150-82a6-3c03d21f3981 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:06.582410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f43c6e-3a3e-4150-82a6-3c03d21f3981 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:06.582687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f43c6e-3a3e-4150-82a6-3c03d21f3981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:06.590427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f43c6e-3a3e-4150-82a6-3c03d21f3981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:06.592013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f43c6e-3a3e-4150-82a6-3c03d21f3981 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:06.601069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 750/1518] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:14.867764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc9160-cc53-4e11-b37b-b81d6d90a29c None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:14.868348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc9160-cc53-4e11-b37b-b81d6d90a29c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:14.868348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc9160-cc53-4e11-b37b-b81d6d90a29c None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:14.869694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 769/1519] 10.222.0.44 () {54 vars in 960 bytes} [Mon May 16 15:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:14.875038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b5217-3b3d-4a08-b17b-8397f8bc44e3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:14.875450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b5217-3b3d-4a08-b17b-8397f8bc44e3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:14.875613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b5217-3b3d-4a08-b17b-8397f8bc44e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:14.894286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b67b5217-3b3d-4a08-b17b-8397f8bc44e3 None None] MFA Rules not processed for user `6dfdb39ae2804b2191cea53f2a387c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:14.895624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b67b5217-3b3d-4a08-b17b-8397f8bc44e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:14.904108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 751/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Mon May 16 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:14.912859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc9160-cc53-4e11-b37b-b81d6d90a29c None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:14.926048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc9160-cc53-4e11-b37b-b81d6d90a29c None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:14.930925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525286ac-c7e0-410c-be98-6aa3feb02e0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dfdb39ae2804b2191cea53f2a387c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:14.931550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525286ac-c7e0-410c-be98-6aa3feb02e0f service placement] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:14.931879 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525286ac-c7e0-410c-be98-6aa3feb02e0f service placement] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:14.932152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525286ac-c7e0-410c-be98-6aa3feb02e0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:14.940698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525286ac-c7e0-410c-be98-6aa3feb02e0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:14.942301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525286ac-c7e0-410c-be98-6aa3feb02e0f service placement] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:14.952154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 770/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:13:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:17.880584 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e101d-8b7f-4c45-b8aa-55a50a82f15f None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:17.881159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e101d-8b7f-4c45-b8aa-55a50a82f15f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:17.881159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e101d-8b7f-4c45-b8aa-55a50a82f15f None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:17.882564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:17.887837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237a7bd-18d2-4f3b-afcd-a02ff537e9d8 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:17.888278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237a7bd-18d2-4f3b-afcd-a02ff537e9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:17.888387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237a7bd-18d2-4f3b-afcd-a02ff537e9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:17.905880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a237a7bd-18d2-4f3b-afcd-a02ff537e9d8 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:17.907088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a237a7bd-18d2-4f3b-afcd-a02ff537e9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:17.915530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:18.067459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e101d-8b7f-4c45-b8aa-55a50a82f15f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:18.082278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e101d-8b7f-4c45-b8aa-55a50a82f15f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:18.087524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ee1fe-0f28-4ccf-84c9-18631867ce3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:18.088147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ee1fe-0f28-4ccf-84c9-18631867ce3f service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:18.088424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ee1fe-0f28-4ccf-84c9-18631867ce3f service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:18.088693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ee1fe-0f28-4ccf-84c9-18631867ce3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:18.096602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ee1fe-0f28-4ccf-84c9-18631867ce3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:18.098258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ee1fe-0f28-4ccf-84c9-18631867ce3f service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:18.107428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 753/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:18.997641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78f3be-3f53-4613-892e-80203ce9535d None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:18.998255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78f3be-3f53-4613-892e-80203ce9535d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:18.998255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78f3be-3f53-4613-892e-80203ce9535d None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:18.999634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 15:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:19.004694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56ffc6-b6ba-4b41-8de4-43fb466dbf05 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:19.005121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56ffc6-b6ba-4b41-8de4-43fb466dbf05 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:19.005249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56ffc6-b6ba-4b41-8de4-43fb466dbf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:19.025594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bd56ffc6-b6ba-4b41-8de4-43fb466dbf05 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:19.027381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bd56ffc6-b6ba-4b41-8de4-43fb466dbf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:19.035154 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:19.187425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78f3be-3f53-4613-892e-80203ce9535d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:19.201713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78f3be-3f53-4613-892e-80203ce9535d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:19.207266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087e23f-07cd-412c-9818-a0e6e89dbe14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:19.207888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087e23f-07cd-412c-9818-a0e6e89dbe14 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:19.208163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087e23f-07cd-412c-9818-a0e6e89dbe14 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:19.208433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087e23f-07cd-412c-9818-a0e6e89dbe14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:19.216864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087e23f-07cd-412c-9818-a0e6e89dbe14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:19.218457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087e23f-07cd-412c-9818-a0e6e89dbe14 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:19.227435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 773/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:23.401875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd739d-7892-461b-a7fd-03205e44fb35 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:23.402506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd739d-7892-461b-a7fd-03205e44fb35 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:23.402506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd739d-7892-461b-a7fd-03205e44fb35 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:23.403811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:23.408799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ace0-0ed6-480b-bc5d-e0433a777ab4 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:23.409237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ace0-0ed6-480b-bc5d-e0433a777ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:23.409350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2ace0-0ed6-480b-bc5d-e0433a777ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:23.427286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-46f2ace0-0ed6-480b-bc5d-e0433a777ab4 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:23.428470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-46f2ace0-0ed6-480b-bc5d-e0433a777ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:23.436164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:23.473478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd739d-7892-461b-a7fd-03205e44fb35 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:23.475154 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e5fd739d-7892-461b-a7fd-03205e44fb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:23.529949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd739d-7892-461b-a7fd-03205e44fb35 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:23.533497 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09bcaa-ec72-4fdf-bc10-158cab021a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:23.534161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09bcaa-ec72-4fdf-bc10-158cab021a06 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:23.534447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09bcaa-ec72-4fdf-bc10-158cab021a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:23.534723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09bcaa-ec72-4fdf-bc10-158cab021a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:23.543461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09bcaa-ec72-4fdf-bc10-158cab021a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:23.544885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09bcaa-ec72-4fdf-bc10-158cab021a06 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:23.554009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 756/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:25.740091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535422-d822-493c-bbf5-c97db2ca6e1a None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:25.740660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535422-d822-493c-bbf5-c97db2ca6e1a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:25.740660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535422-d822-493c-bbf5-c97db2ca6e1a None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:25.742015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:25.747332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054ced-6131-423c-ba47-20116da26118 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:25.747707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054ced-6131-423c-ba47-20116da26118 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:25.747892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054ced-6131-423c-ba47-20116da26118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:25.765804 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-88054ced-6131-423c-ba47-20116da26118 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:25.767026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-88054ced-6131-423c-ba47-20116da26118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:25.774821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:25.809794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535422-d822-493c-bbf5-c97db2ca6e1a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:25.820049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535422-d822-493c-bbf5-c97db2ca6e1a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:25.823999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131d14c-73f3-4872-9b50-a28b656da368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:25.824616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131d14c-73f3-4872-9b50-a28b656da368 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:25.824893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131d14c-73f3-4872-9b50-a28b656da368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:25.825162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131d14c-73f3-4872-9b50-a28b656da368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:25.833920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131d14c-73f3-4872-9b50-a28b656da368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:25.835350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131d14c-73f3-4872-9b50-a28b656da368 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:25.844888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 776/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:29.649416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d850-a2db-41de-bca5-0f9d2b2f1b6f None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:29.649982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d850-a2db-41de-bca5-0f9d2b2f1b6f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:29.649982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606d850-a2db-41de-bca5-0f9d2b2f1b6f None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:29.651388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:29.656667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d38ae9-f694-4484-8bd8-ff87b12ee45d None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:29.657113 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d38ae9-f694-4484-8bd8-ff87b12ee45d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:29.657255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d38ae9-f694-4484-8bd8-ff87b12ee45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:29.675030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a8d38ae9-f694-4484-8bd8-ff87b12ee45d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:29.676205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a8d38ae9-f694-4484-8bd8-ff87b12ee45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:29.684464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:29.953229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606d850-a2db-41de-bca5-0f9d2b2f1b6f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:29.955001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7606d850-a2db-41de-bca5-0f9d2b2f1b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:30.011810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606d850-a2db-41de-bca5-0f9d2b2f1b6f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:30.015589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb4c16-d83e-44a2-9522-c437e0fb0c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:30.016241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb4c16-d83e-44a2-9522-c437e0fb0c96 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:30.016522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb4c16-d83e-44a2-9522-c437e0fb0c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:30.016796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb4c16-d83e-44a2-9522-c437e0fb0c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:30.026393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb4c16-d83e-44a2-9522-c437e0fb0c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:30.027822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb4c16-d83e-44a2-9522-c437e0fb0c96 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:30.037060 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 759/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:13:32.302765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9b5e-3d49-4476-b8c4-81381732bb76 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.303230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9b5e-3d49-4476-b8c4-81381732bb76 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.303338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9b5e-3d49-4476-b8c4-81381732bb76 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.304695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:13:32.310405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eafeb-54ae-4012-844a-240d6accb9dd None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.310832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eafeb-54ae-4012-844a-240d6accb9dd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.310945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eafeb-54ae-4012-844a-240d6accb9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.329438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fb4eafeb-54ae-4012-844a-240d6accb9dd None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:13:32.330703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fb4eafeb-54ae-4012-844a-240d6accb9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:32.338355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:13:32.606705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb9b5e-3d49-4476-b8c4-81381732bb76 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:13:32.608424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3dbb9b5e-3d49-4476-b8c4-81381732bb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:13:32.621470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb9b5e-3d49-4476-b8c4-81381732bb76 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:13:32.624952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1433d-8c37-46a4-8b11-e6fc8334147f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:13:32.625565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1433d-8c37-46a4-8b11-e6fc8334147f service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:13:32.625841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1433d-8c37-46a4-8b11-e6fc8334147f service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:13:32.626143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1433d-8c37-46a4-8b11-e6fc8334147f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:13:32.634612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1433d-8c37-46a4-8b11-e6fc8334147f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:13:32.636018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1433d-8c37-46a4-8b11-e6fc8334147f service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:13:32.644991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 779/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:06.328678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d749-a6d8-4553-bddf-4cd4a34c931b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.329269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d749-a6d8-4553-bddf-4cd4a34c931b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.329269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d749-a6d8-4553-bddf-4cd4a34c931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.357264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cbec4-930d-4189-8067-3668ede5e0cf None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.358377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cbec4-930d-4189-8067-3668ede5e0cf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.358886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cbec4-930d-4189-8067-3668ede5e0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.364300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e372d749-a6d8-4553-bddf-4cd4a34c931b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.364300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e372d749-a6d8-4553-bddf-4cd4a34c931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.382624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 761/1540] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:06.384246 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ea5cbec4-930d-4189-8067-3668ede5e0cf None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.385679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ea5cbec4-930d-4189-8067-3668ede5e0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.394523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52d97-dce8-4702-b301-5411dad27f4e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.394870 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52d97-dce8-4702-b301-5411dad27f4e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.395067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52d97-dce8-4702-b301-5411dad27f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.397504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 780/1541] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:06.420237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fed52d97-dce8-4702-b301-5411dad27f4e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.421487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fed52d97-dce8-4702-b301-5411dad27f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.430420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae815a-00da-4c45-a5fe-c222e17628c0 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.430719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae815a-00da-4c45-a5fe-c222e17628c0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.430984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae815a-00da-4c45-a5fe-c222e17628c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.432472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 762/1542] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:06.437798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52d97-dce8-4702-b301-5411dad27f4e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:06.450673 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52d97-dce8-4702-b301-5411dad27f4e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:06.457454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc17068-e944-46cc-8195-97e42c5e4470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:06.458201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc17068-e944-46cc-8195-97e42c5e4470 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.458474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc17068-e944-46cc-8195-97e42c5e4470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.458723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2eae815a-00da-4c45-a5fe-c222e17628c0 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.458850 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc17068-e944-46cc-8195-97e42c5e4470 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.459462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc17068-e944-46cc-8195-97e42c5e4470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:06.459771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc17068-e944-46cc-8195-97e42c5e4470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:06.460038 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2eae815a-00da-4c45-a5fe-c222e17628c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.461535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc17068-e944-46cc-8195-97e42c5e4470 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:06.484812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 763/1543] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:15:06.487184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 781/1544] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:06.493580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc17068-e944-46cc-8195-97e42c5e4470 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:06.499376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae815a-00da-4c45-a5fe-c222e17628c0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:06.508214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc17068-e944-46cc-8195-97e42c5e4470 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:06.509778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae815a-00da-4c45-a5fe-c222e17628c0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:06.518010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4ab3a-913d-4188-b371-8365983c487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:06.519764 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4ab3a-913d-4188-b371-8365983c487a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.520052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4ab3a-913d-4188-b371-8365983c487a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.520429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4ab3a-913d-4188-b371-8365983c487a admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.521181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4ab3a-913d-4188-b371-8365983c487a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:06.521487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4ab3a-913d-4188-b371-8365983c487a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:06.523233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4ab3a-913d-4188-b371-8365983c487a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:06.523523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b18750-8962-46b4-9180-69cbadc036ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:06.524249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18750-8962-46b4-9180-69cbadc036ac admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.524534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18750-8962-46b4-9180-69cbadc036ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.524969 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18750-8962-46b4-9180-69cbadc036ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.525563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b18750-8962-46b4-9180-69cbadc036ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:06.527868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b18750-8962-46b4-9180-69cbadc036ac admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:06.545348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 764/1545] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:06.553434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4ab3a-913d-4188-b371-8365983c487a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:06.571598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4ab3a-913d-4188-b371-8365983c487a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:06.582911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684619a5-7b6e-40b3-9935-b71288ffe3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:06.583585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684619a5-7b6e-40b3-9935-b71288ffe3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.583864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684619a5-7b6e-40b3-9935-b71288ffe3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.584137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684619a5-7b6e-40b3-9935-b71288ffe3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.584828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684619a5-7b6e-40b3-9935-b71288ffe3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:06.585917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-684619a5-7b6e-40b3-9935-b71288ffe3e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:15:06.585917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: warnings.warn(msg) May 16 15:15:06.585917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: May 16 15:15:06.587136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684619a5-7b6e-40b3-9935-b71288ffe3e2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:06.636572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 782/1546] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:06.637973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e0b44-fec2-4c80-87ca-9d078388ab40 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.638290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e0b44-fec2-4c80-87ca-9d078388ab40 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.638558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e0b44-fec2-4c80-87ca-9d078388ab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.661249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e48e0b44-fec2-4c80-87ca-9d078388ab40 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.662445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e48e0b44-fec2-4c80-87ca-9d078388ab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.691127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 765/1547] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:15:06.700518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d4cb-96a5-472e-81ff-c8f7d9b3cbd5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.700518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d4cb-96a5-472e-81ff-c8f7d9b3cbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.700518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4d4cb-96a5-472e-81ff-c8f7d9b3cbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.712877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d7c4d4cb-96a5-472e-81ff-c8f7d9b3cbd5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.714128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d7c4d4cb-96a5-472e-81ff-c8f7d9b3cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.720735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 783/1548] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:06.723187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76326bac-f82d-4af2-af28-54dfcf16c741 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.724144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76326bac-f82d-4af2-af28-54dfcf16c741 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.725299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76326bac-f82d-4af2-af28-54dfcf16c741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.746920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-76326bac-f82d-4af2-af28-54dfcf16c741 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.748123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-76326bac-f82d-4af2-af28-54dfcf16c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.774709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 766/1549] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:06.776102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51ebc1-87b7-45ff-85bf-3d00e7c7647e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.776390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51ebc1-87b7-45ff-85bf-3d00e7c7647e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.776663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51ebc1-87b7-45ff-85bf-3d00e7c7647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.794382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9e51ebc1-87b7-45ff-85bf-3d00e7c7647e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.795562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9e51ebc1-87b7-45ff-85bf-3d00e7c7647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.803172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 767/1550] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:06.804038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51ebc1-87b7-45ff-85bf-3d00e7c7647e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:06.808514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 784/1551] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:06.809995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de784e99-65fb-41d8-9ab7-b84affbe1c5b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.810375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de784e99-65fb-41d8-9ab7-b84affbe1c5b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.810661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de784e99-65fb-41d8-9ab7-b84affbe1c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.820821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51ebc1-87b7-45ff-85bf-3d00e7c7647e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:06.825630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f6d57-0556-40fd-a9ac-92c14b8922e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:06.826316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f6d57-0556-40fd-a9ac-92c14b8922e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.826602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f6d57-0556-40fd-a9ac-92c14b8922e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.826874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f6d57-0556-40fd-a9ac-92c14b8922e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.827549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f6d57-0556-40fd-a9ac-92c14b8922e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:06.827979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-de784e99-65fb-41d8-9ab7-b84affbe1c5b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.829166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-de784e99-65fb-41d8-9ab7-b84affbe1c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.829469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f6d57-0556-40fd-a9ac-92c14b8922e6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:06.837451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 785/1552] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:06.838229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de784e99-65fb-41d8-9ab7-b84affbe1c5b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:06.848159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de784e99-65fb-41d8-9ab7-b84affbe1c5b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:06.854186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372f111-8475-472e-8f6d-e01f55897efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:06.854186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372f111-8475-472e-8f6d-e01f55897efe admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.854186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372f111-8475-472e-8f6d-e01f55897efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.854186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372f111-8475-472e-8f6d-e01f55897efe admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.854582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372f111-8475-472e-8f6d-e01f55897efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:06.855582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WARNING py.warnings [None req-4372f111-8475-472e-8f6d-e01f55897efe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:15:06.855582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: warnings.warn(msg) May 16 15:15:06.855582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: May 16 15:15:06.856809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372f111-8475-472e-8f6d-e01f55897efe admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:06.943551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 768/1553] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:06.944896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b108b0f-c2d8-4ce0-b13d-a08d9983085f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.945184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b108b0f-c2d8-4ce0-b13d-a08d9983085f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.945453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b108b0f-c2d8-4ce0-b13d-a08d9983085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.963262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1b108b0f-c2d8-4ce0-b13d-a08d9983085f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:06.964439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1b108b0f-c2d8-4ce0-b13d-a08d9983085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:06.972205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 769/1554] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:06.973512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a947b-3ea7-4b8c-9f7a-8811e1b918bb None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.973788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a947b-3ea7-4b8c-9f7a-8811e1b918bb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.978835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 786/1555] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:06.979726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27d9a-9872-4fd8-83db-1c6da324d6c9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:06.982701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27d9a-9872-4fd8-83db-1c6da324d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:06.982701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27d9a-9872-4fd8-83db-1c6da324d6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.984687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a947b-3ea7-4b8c-9f7a-8811e1b918bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:06.998786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-97f27d9a-9872-4fd8-83db-1c6da324d6c9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:07.000010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-97f27d9a-9872-4fd8-83db-1c6da324d6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:07.005957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-791a947b-3ea7-4b8c-9f7a-8811e1b918bb None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:07.007176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-791a947b-3ea7-4b8c-9f7a-8811e1b918bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:07.010080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 787/1556] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:07.011460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9a010-f90c-4f64-a0e7-3de48ccd45cd None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.015207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9a010-f90c-4f64-a0e7-3de48ccd45cd None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.015207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9a010-f90c-4f64-a0e7-3de48ccd45cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.019490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 770/1557] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:07.020706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c3345-2316-4f04-802c-4bf617863793 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.021144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c3345-2316-4f04-802c-4bf617863793 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.021434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c3345-2316-4f04-802c-4bf617863793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.034663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-bea9a010-f90c-4f64-a0e7-3de48ccd45cd None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:07.035848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bea9a010-f90c-4f64-a0e7-3de48ccd45cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:07.038723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-518c3345-2316-4f04-802c-4bf617863793 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:07.039864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-518c3345-2316-4f04-802c-4bf617863793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:07.043658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 788/1558] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:07.048554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a0636-93ef-4cec-8714-9f57704d359d None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.048554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a0636-93ef-4cec-8714-9f57704d359d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.048554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a0636-93ef-4cec-8714-9f57704d359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.048874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 771/1559] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:07.049233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c3345-2316-4f04-802c-4bf617863793 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.058953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c3345-2316-4f04-802c-4bf617863793 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.063615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4105-caff-449c-a17b-a06cb39f7599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.064254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4105-caff-449c-a17b-a06cb39f7599 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.064534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7c2a0636-93ef-4cec-8714-9f57704d359d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:07.064671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4105-caff-449c-a17b-a06cb39f7599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.064800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4105-caff-449c-a17b-a06cb39f7599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.066096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc4105-caff-449c-a17b-a06cb39f7599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.066272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7c2a0636-93ef-4cec-8714-9f57704d359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:07.067676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc4105-caff-449c-a17b-a06cb39f7599 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.077711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 789/1560] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:07.078268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 772/1561] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:07.079078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4105-caff-449c-a17b-a06cb39f7599 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.079958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555ad68-2c22-443f-8314-babd7c8ac751 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.080446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555ad68-2c22-443f-8314-babd7c8ac751 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.082188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555ad68-2c22-443f-8314-babd7c8ac751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.089097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4105-caff-449c-a17b-a06cb39f7599 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.093530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0187ba-cb4d-4a40-a736-b54728c5bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.094190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0187ba-cb4d-4a40-a736-b54728c5bbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.094467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0187ba-cb4d-4a40-a736-b54728c5bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.094733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0187ba-cb4d-4a40-a736-b54728c5bbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.095460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0187ba-cb4d-4a40-a736-b54728c5bbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.097069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0187ba-cb4d-4a40-a736-b54728c5bbf3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.099315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2555ad68-2c22-443f-8314-babd7c8ac751 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:07.100489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2555ad68-2c22-443f-8314-babd7c8ac751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:07.109625 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 773/1562] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:07.109625 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0187ba-cb4d-4a40-a736-b54728c5bbf3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.111333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 790/1563] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:07.115669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555ad68-2c22-443f-8314-babd7c8ac751 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.119587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0187ba-cb4d-4a40-a736-b54728c5bbf3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.124355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674eb57e-9218-45ab-99d4-e6d6303e52c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.125131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eb57e-9218-45ab-99d4-e6d6303e52c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.125248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555ad68-2c22-443f-8314-babd7c8ac751 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.125523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eb57e-9218-45ab-99d4-e6d6303e52c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.125912 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eb57e-9218-45ab-99d4-e6d6303e52c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.126658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eb57e-9218-45ab-99d4-e6d6303e52c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:07.127100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eb57e-9218-45ab-99d4-e6d6303e52c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.129226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eb57e-9218-45ab-99d4-e6d6303e52c5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.130999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.131670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.131949 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.132218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.132932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:07.133233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.134271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WARNING py.warnings [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 15:15:07.134271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: warnings.warn(msg) May 16 15:15:07.134271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: May 16 15:15:07.135135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.141249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 774/1564] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:07.142350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674eb57e-9218-45ab-99d4-e6d6303e52c5 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.147317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 791/1565] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:07.153526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674eb57e-9218-45ab-99d4-e6d6303e52c5 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.157365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.158251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775291c7-4c33-4a68-9e95-bb7d50928eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.158922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775291c7-4c33-4a68-9e95-bb7d50928eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.159207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775291c7-4c33-4a68-9e95-bb7d50928eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.159483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775291c7-4c33-4a68-9e95-bb7d50928eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.160198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775291c7-4c33-4a68-9e95-bb7d50928eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:07.160500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775291c7-4c33-4a68-9e95-bb7d50928eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.162098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775291c7-4c33-4a68-9e95-bb7d50928eb4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.164381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95804a4a-5c1b-4a9c-90b7-36d9852e13d2 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.169041 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5edf25-7365-4247-9426-06e92c3e8942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.169673 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5edf25-7365-4247-9426-06e92c3e8942 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.169953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5edf25-7365-4247-9426-06e92c3e8942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.170270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5edf25-7365-4247-9426-06e92c3e8942 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.170980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5edf25-7365-4247-9426-06e92c3e8942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:07.171282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5edf25-7365-4247-9426-06e92c3e8942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.172843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5edf25-7365-4247-9426-06e92c3e8942 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.173658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 775/1566] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:07.174473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775291c7-4c33-4a68-9e95-bb7d50928eb4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.183980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775291c7-4c33-4a68-9e95-bb7d50928eb4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.185015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 792/1567] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:07.185936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5edf25-7365-4247-9426-06e92c3e8942 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.188687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7215397-15f8-4e0d-bca2-9cac0fedf87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.189391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7215397-15f8-4e0d-bca2-9cac0fedf87d admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.189678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7215397-15f8-4e0d-bca2-9cac0fedf87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.189954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7215397-15f8-4e0d-bca2-9cac0fedf87d admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.191276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7215397-15f8-4e0d-bca2-9cac0fedf87d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:07.191580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7215397-15f8-4e0d-bca2-9cac0fedf87d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.193253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7215397-15f8-4e0d-bca2-9cac0fedf87d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.198679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5edf25-7365-4247-9426-06e92c3e8942 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.201780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0234-c220-4e35-8985-f1b5a205bf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.202458 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0234-c220-4e35-8985-f1b5a205bf6f admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.202737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0234-c220-4e35-8985-f1b5a205bf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.203004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0234-c220-4e35-8985-f1b5a205bf6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.203751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0234-c220-4e35-8985-f1b5a205bf6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.205352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0234-c220-4e35-8985-f1b5a205bf6f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.210334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 776/1568] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:07.210334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7215397-15f8-4e0d-bca2-9cac0fedf87d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.218929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 793/1569] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:07.218929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0234-c220-4e35-8985-f1b5a205bf6f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.219441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7215397-15f8-4e0d-bca2-9cac0fedf87d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.224653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc1d9b-6a32-477e-8b10-22631cbdc0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.227332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1d9b-6a32-477e-8b10-22631cbdc0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.227332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1d9b-6a32-477e-8b10-22631cbdc0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.227332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc1d9b-6a32-477e-8b10-22631cbdc0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.227652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0234-c220-4e35-8985-f1b5a205bf6f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.227752 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc1d9b-6a32-477e-8b10-22631cbdc0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.228193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc1d9b-6a32-477e-8b10-22631cbdc0ae admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.231225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13996b33-f767-4a53-95c1-29dc075c57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.231845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13996b33-f767-4a53-95c1-29dc075c57ea admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.232125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13996b33-f767-4a53-95c1-29dc075c57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.232446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13996b33-f767-4a53-95c1-29dc075c57ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.233159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13996b33-f767-4a53-95c1-29dc075c57ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:07.233573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13996b33-f767-4a53-95c1-29dc075c57ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.235153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13996b33-f767-4a53-95c1-29dc075c57ea admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.241709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 777/1570] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:07.241709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc1d9b-6a32-477e-8b10-22631cbdc0ae admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.254231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 794/1571] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:07.254231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13996b33-f767-4a53-95c1-29dc075c57ea admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.254498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc1d9b-6a32-477e-8b10-22631cbdc0ae admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.254498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0986-eb18-405d-b7a5-44564e7b3f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.254498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0986-eb18-405d-b7a5-44564e7b3f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.254807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0986-eb18-405d-b7a5-44564e7b3f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.254903 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a0986-eb18-405d-b7a5-44564e7b3f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.255544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a0986-eb18-405d-b7a5-44564e7b3f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.257429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a0986-eb18-405d-b7a5-44564e7b3f3c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.259722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13996b33-f767-4a53-95c1-29dc075c57ea admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.264262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d5f1e-d21e-4485-af15-d9a34225497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.264910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d5f1e-d21e-4485-af15-d9a34225497b admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.265187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d5f1e-d21e-4485-af15-d9a34225497b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.265460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d5f1e-d21e-4485-af15-d9a34225497b admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.266160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d5f1e-d21e-4485-af15-d9a34225497b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.268018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d5f1e-d21e-4485-af15-d9a34225497b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.406815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 778/1572] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:07.408391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0986-eb18-405d-b7a5-44564e7b3f3c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.424948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 795/1573] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:07.424948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d5f1e-d21e-4485-af15-d9a34225497b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.467464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a0986-eb18-405d-b7a5-44564e7b3f3c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.481593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d5f1e-d21e-4485-af15-d9a34225497b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.486086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad801c-8881-4e62-8c9f-285d770d1bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.486742 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad801c-8881-4e62-8c9f-285d770d1bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.487060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad801c-8881-4e62-8c9f-285d770d1bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.487332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad801c-8881-4e62-8c9f-285d770d1bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.488013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad801c-8881-4e62-8c9f-285d770d1bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.489899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad801c-8881-4e62-8c9f-285d770d1bf9 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.521646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5fe8d-8914-4bd3-a3a5-1ca1a63bc3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.522335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5fe8d-8914-4bd3-a3a5-1ca1a63bc3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.522618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5fe8d-8914-4bd3-a3a5-1ca1a63bc3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.522892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5fe8d-8914-4bd3-a3a5-1ca1a63bc3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.523577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5fe8d-8914-4bd3-a3a5-1ca1a63bc3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.525503 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5fe8d-8914-4bd3-a3a5-1ca1a63bc3a2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.575067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 796/1574] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/projects => generated 403 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:07.575067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad801c-8881-4e62-8c9f-285d770d1bf9 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.631714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad801c-8881-4e62-8c9f-285d770d1bf9 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.636221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf44597-50bb-49d4-89e4-5b1621f35ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.636866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf44597-50bb-49d4-89e4-5b1621f35ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.637145 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf44597-50bb-49d4-89e4-5b1621f35ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.637440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf44597-50bb-49d4-89e4-5b1621f35ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.638122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf44597-50bb-49d4-89e4-5b1621f35ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.640022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf44597-50bb-49d4-89e4-5b1621f35ff0 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.693189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 779/1575] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:07.694096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5fe8d-8914-4bd3-a3a5-1ca1a63bc3a2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.751958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5fe8d-8914-4bd3-a3a5-1ca1a63bc3a2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.756946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7c65e-010c-4689-ab1c-205b9e44659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.757826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7c65e-010c-4689-ab1c-205b9e44659b admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.758133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7c65e-010c-4689-ab1c-205b9e44659b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.758414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7c65e-010c-4689-ab1c-205b9e44659b admin admin] PATH_INFO: `/v3/projects/316917d7a31645bfaac651f81154c18f/users/a14795cb97ac44b2a7fc1e2f79b12253/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.765543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 797/1576] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:07.765543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf44597-50bb-49d4-89e4-5b1621f35ff0 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.773734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7c65e-010c-4689-ab1c-205b9e44659b admin admin] RBAC: Authorizing `identity:create_grant(project_id=316917d7a31645bfaac651f81154c18f, user_id=a14795cb97ac44b2a7fc1e2f79b12253, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.774459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-27f7c65e-010c-4689-ab1c-205b9e44659b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:15:07.774459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: warnings.warn(msg) May 16 15:15:07.774459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: May 16 15:15:07.776381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7c65e-010c-4689-ab1c-205b9e44659b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.824856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf44597-50bb-49d4-89e4-5b1621f35ff0 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.829609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031914f-d835-4e82-8279-f499a8560ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.830550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031914f-d835-4e82-8279-f499a8560ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.831417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031914f-d835-4e82-8279-f499a8560ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.831692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031914f-d835-4e82-8279-f499a8560ab1 admin admin] PATH_INFO: `/v3/projects/d143bc5a616249a7beefc7b27962026b/users/44ffd5660baa40a7a3d6918cb5d31e56/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.845691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031914f-d835-4e82-8279-f499a8560ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d143bc5a616249a7beefc7b27962026b, user_id=44ffd5660baa40a7a3d6918cb5d31e56, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.848382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031914f-d835-4e82-8279-f499a8560ab1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.923917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 780/1577] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:07 2022] PUT /identity/v3/projects/316917d7a31645bfaac651f81154c18f/users/a14795cb97ac44b2a7fc1e2f79b12253/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:07.924981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7c65e-010c-4689-ab1c-205b9e44659b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:07.984622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7c65e-010c-4689-ab1c-205b9e44659b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:07.989196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcbea3-797f-452a-80e0-7e25453913ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:07.989843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcbea3-797f-452a-80e0-7e25453913ae admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:07.990149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcbea3-797f-452a-80e0-7e25453913ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:07.990480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcbea3-797f-452a-80e0-7e25453913ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:07.991156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcbea3-797f-452a-80e0-7e25453913ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:07.993052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcbea3-797f-452a-80e0-7e25453913ae admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:07.997870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 798/1578] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:07 2022] PUT /identity/v3/projects/d143bc5a616249a7beefc7b27962026b/users/44ffd5660baa40a7a3d6918cb5d31e56/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:08.003329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031914f-d835-4e82-8279-f499a8560ab1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.061467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031914f-d835-4e82-8279-f499a8560ab1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.066573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f13cc8-88e8-4651-a09b-f5bc073e8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.067234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13cc8-88e8-4651-a09b-f5bc073e8a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.067516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13cc8-88e8-4651-a09b-f5bc073e8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.067805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13cc8-88e8-4651-a09b-f5bc073e8a42 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.068470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f13cc8-88e8-4651-a09b-f5bc073e8a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.070423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f13cc8-88e8-4651-a09b-f5bc073e8a42 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.188129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 799/1579] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/users => generated 303 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:08.188986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f13cc8-88e8-4651-a09b-f5bc073e8a42 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.199000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f13cc8-88e8-4651-a09b-f5bc073e8a42 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.208315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 781/1580] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:07 2022] POST /identity/v3/projects => generated 363 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:08.208315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcbea3-797f-452a-80e0-7e25453913ae admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.252409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cec33e-cb13-4cbc-a34d-a966a3d15a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.254022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cec33e-cb13-4cbc-a34d-a966a3d15a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.254288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cec33e-cb13-4cbc-a34d-a966a3d15a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.254588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cec33e-cb13-4cbc-a34d-a966a3d15a99 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.255301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cec33e-cb13-4cbc-a34d-a966a3d15a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.257373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cec33e-cb13-4cbc-a34d-a966a3d15a99 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.263763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcbea3-797f-452a-80e0-7e25453913ae admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.268984 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bdccc-dae0-4ebe-903c-79972697d277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.269658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bdccc-dae0-4ebe-903c-79972697d277 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.269942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bdccc-dae0-4ebe-903c-79972697d277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.270245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bdccc-dae0-4ebe-903c-79972697d277 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.270928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bdccc-dae0-4ebe-903c-79972697d277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.272881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bdccc-dae0-4ebe-903c-79972697d277 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.372945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 800/1581] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:08 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:08.372945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cec33e-cb13-4cbc-a34d-a966a3d15a99 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.381350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cec33e-cb13-4cbc-a34d-a966a3d15a99 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.386157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f25bd-0feb-412b-a58c-c5ca4f102c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.386803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f25bd-0feb-412b-a58c-c5ca4f102c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.387087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f25bd-0feb-412b-a58c-c5ca4f102c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.387363 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f25bd-0feb-412b-a58c-c5ca4f102c93 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.388044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f25bd-0feb-412b-a58c-c5ca4f102c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.389951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f25bd-0feb-412b-a58c-c5ca4f102c93 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.398599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 782/1582] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:08 2022] POST /identity/v3/users => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:08.399336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bdccc-dae0-4ebe-903c-79972697d277 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.410330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bdccc-dae0-4ebe-903c-79972697d277 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.415030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59821866-c15f-4863-bad3-c4144b8332e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.415697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59821866-c15f-4863-bad3-c4144b8332e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.416039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59821866-c15f-4863-bad3-c4144b8332e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.416308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59821866-c15f-4863-bad3-c4144b8332e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.417000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59821866-c15f-4863-bad3-c4144b8332e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.418921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59821866-c15f-4863-bad3-c4144b8332e0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.475730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 801/1583] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:08 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:08.475730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beec3e-3537-45cf-9cb0-01ff9b626013 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.475730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beec3e-3537-45cf-9cb0-01ff9b626013 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.475730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beec3e-3537-45cf-9cb0-01ff9b626013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.492756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-88beec3e-3537-45cf-9cb0-01ff9b626013 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:08.494015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-88beec3e-3537-45cf-9cb0-01ff9b626013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:08.501241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 783/1584] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:08 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:08.502262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 802/1585] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:08.502699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5930e-d3ab-4833-9253-fd1dedb4bf18 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.502992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5930e-d3ab-4833-9253-fd1dedb4bf18 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.503189 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beec3e-3537-45cf-9cb0-01ff9b626013 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.503328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5930e-d3ab-4833-9253-fd1dedb4bf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.512806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beec3e-3537-45cf-9cb0-01ff9b626013 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.517567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c28b-5cfe-41e7-b6f7-082ceea90edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.518284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c28b-5cfe-41e7-b6f7-082ceea90edf admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.523128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c28b-5cfe-41e7-b6f7-082ceea90edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.523128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c28b-5cfe-41e7-b6f7-082ceea90edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.523128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383c28b-5cfe-41e7-b6f7-082ceea90edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.523405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7ec5930e-d3ab-4833-9253-fd1dedb4bf18 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:08.523511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383c28b-5cfe-41e7-b6f7-082ceea90edf admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.523610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7ec5930e-d3ab-4833-9253-fd1dedb4bf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:08.532980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 784/1586] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:08.532980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5930e-d3ab-4833-9253-fd1dedb4bf18 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.533231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 803/1587] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.533231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c28b-5cfe-41e7-b6f7-082ceea90edf admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.543705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c28b-5cfe-41e7-b6f7-082ceea90edf admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.548452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5930e-d3ab-4833-9253-fd1dedb4bf18 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.548615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d840b-0513-43c6-94be-a1057e94d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.549214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d840b-0513-43c6-94be-a1057e94d7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.549546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d840b-0513-43c6-94be-a1057e94d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.550386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d840b-0513-43c6-94be-a1057e94d7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.551151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d840b-0513-43c6-94be-a1057e94d7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.555703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d840b-0513-43c6-94be-a1057e94d7d2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.555809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86c28d-d4a5-4536-844b-92f7067834af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.555809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86c28d-d4a5-4536-844b-92f7067834af admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.555809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86c28d-d4a5-4536-844b-92f7067834af admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.555809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86c28d-d4a5-4536-844b-92f7067834af admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.556129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86c28d-d4a5-4536-844b-92f7067834af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.557493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86c28d-d4a5-4536-844b-92f7067834af admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.562512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 804/1588] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.563301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d840b-0513-43c6-94be-a1057e94d7d2 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.573583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d840b-0513-43c6-94be-a1057e94d7d2 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.578149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bcc7b-993a-4714-84a6-467783be5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.578787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bcc7b-993a-4714-84a6-467783be5a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.579066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bcc7b-993a-4714-84a6-467783be5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.579339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bcc7b-993a-4714-84a6-467783be5a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.580048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bcc7b-993a-4714-84a6-467783be5a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.581614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bcc7b-993a-4714-84a6-467783be5a8e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.591323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 805/1589] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.592080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bcc7b-993a-4714-84a6-467783be5a8e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.601366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bcc7b-993a-4714-84a6-467783be5a8e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.606008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d282c13-60d5-45ed-8197-fe76da3f1c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.606666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d282c13-60d5-45ed-8197-fe76da3f1c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.606945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d282c13-60d5-45ed-8197-fe76da3f1c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.607229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d282c13-60d5-45ed-8197-fe76da3f1c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.607904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d282c13-60d5-45ed-8197-fe76da3f1c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.609462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d282c13-60d5-45ed-8197-fe76da3f1c89 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.619555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 806/1590] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.620364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d282c13-60d5-45ed-8197-fe76da3f1c89 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.629335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d282c13-60d5-45ed-8197-fe76da3f1c89 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.633728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62b6d-ca99-4e26-8bcd-97240b408cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.634348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62b6d-ca99-4e26-8bcd-97240b408cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.634626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62b6d-ca99-4e26-8bcd-97240b408cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.634896 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62b6d-ca99-4e26-8bcd-97240b408cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.635575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af62b6d-ca99-4e26-8bcd-97240b408cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.637174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af62b6d-ca99-4e26-8bcd-97240b408cd5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.644073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 785/1591] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:08 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:08.644831 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86c28d-d4a5-4536-844b-92f7067834af admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.647705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 807/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.647705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62b6d-ca99-4e26-8bcd-97240b408cd5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.656738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62b6d-ca99-4e26-8bcd-97240b408cd5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.661906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35b445-5c1f-4256-9f24-f3d809a3c215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.662566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35b445-5c1f-4256-9f24-f3d809a3c215 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.662842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35b445-5c1f-4256-9f24-f3d809a3c215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.663113 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35b445-5c1f-4256-9f24-f3d809a3c215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.663828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35b445-5c1f-4256-9f24-f3d809a3c215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.665474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35b445-5c1f-4256-9f24-f3d809a3c215 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.675749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 808/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.676525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35b445-5c1f-4256-9f24-f3d809a3c215 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.700961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86c28d-d4a5-4536-844b-92f7067834af admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.705113 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18066a23-257f-439c-a132-522efe9483a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.705837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066a23-257f-439c-a132-522efe9483a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.706243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066a23-257f-439c-a132-522efe9483a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.706581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066a23-257f-439c-a132-522efe9483a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.715430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18066a23-257f-439c-a132-522efe9483a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.717166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18066a23-257f-439c-a132-522efe9483a3 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.727059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 786/1594] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:08.727431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35b445-5c1f-4256-9f24-f3d809a3c215 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.728156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18066a23-257f-439c-a132-522efe9483a3 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.731066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407d4bc-7bde-4066-89dd-76b8abd0ff37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.731705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407d4bc-7bde-4066-89dd-76b8abd0ff37 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.731985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407d4bc-7bde-4066-89dd-76b8abd0ff37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.732264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407d4bc-7bde-4066-89dd-76b8abd0ff37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.738606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18066a23-257f-439c-a132-522efe9483a3 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.743490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407d4bc-7bde-4066-89dd-76b8abd0ff37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.744803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466d7eb-badd-4e16-b07a-f6f1a7326745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.744937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407d4bc-7bde-4066-89dd-76b8abd0ff37 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.745462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d7eb-badd-4e16-b07a-f6f1a7326745 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.746145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d7eb-badd-4e16-b07a-f6f1a7326745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.746837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d7eb-badd-4e16-b07a-f6f1a7326745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.747552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466d7eb-badd-4e16-b07a-f6f1a7326745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.749117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466d7eb-badd-4e16-b07a-f6f1a7326745 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.754858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 809/1595] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:08.756331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407d4bc-7bde-4066-89dd-76b8abd0ff37 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.762716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 787/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.762716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466d7eb-badd-4e16-b07a-f6f1a7326745 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.764701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407d4bc-7bde-4066-89dd-76b8abd0ff37 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.771106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cfb7c-d7ee-41a6-86c6-21328fbb0647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.771637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466d7eb-badd-4e16-b07a-f6f1a7326745 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.771752 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cfb7c-d7ee-41a6-86c6-21328fbb0647 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.772026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cfb7c-d7ee-41a6-86c6-21328fbb0647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.772299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cfb7c-d7ee-41a6-86c6-21328fbb0647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.773151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cfb7c-d7ee-41a6-86c6-21328fbb0647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.774831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cfb7c-d7ee-41a6-86c6-21328fbb0647 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.776441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0a55d-7af2-4923-9ec8-fde5f56af84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.777096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0a55d-7af2-4923-9ec8-fde5f56af84a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.777375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0a55d-7af2-4923-9ec8-fde5f56af84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.777648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0a55d-7af2-4923-9ec8-fde5f56af84a admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.778482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0a55d-7af2-4923-9ec8-fde5f56af84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.779982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0a55d-7af2-4923-9ec8-fde5f56af84a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.786570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 810/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.786570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cfb7c-d7ee-41a6-86c6-21328fbb0647 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.792759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 788/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.792759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0a55d-7af2-4923-9ec8-fde5f56af84a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.797993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cfb7c-d7ee-41a6-86c6-21328fbb0647 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.801031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0a55d-7af2-4923-9ec8-fde5f56af84a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.802744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc87fa-e381-4b5e-aa63-5c58902de036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.803417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc87fa-e381-4b5e-aa63-5c58902de036 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.803694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc87fa-e381-4b5e-aa63-5c58902de036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.803967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc87fa-e381-4b5e-aa63-5c58902de036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.804676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc87fa-e381-4b5e-aa63-5c58902de036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.805606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962436a-743f-4054-9b68-00fbd1f38e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.806267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962436a-743f-4054-9b68-00fbd1f38e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.806378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc87fa-e381-4b5e-aa63-5c58902de036 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.806550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962436a-743f-4054-9b68-00fbd1f38e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.806820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962436a-743f-4054-9b68-00fbd1f38e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.807528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962436a-743f-4054-9b68-00fbd1f38e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.809106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962436a-743f-4054-9b68-00fbd1f38e89 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.817112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 811/1599] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.817112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc87fa-e381-4b5e-aa63-5c58902de036 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.821290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 789/1600] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:08.821290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962436a-743f-4054-9b68-00fbd1f38e89 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.826933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc87fa-e381-4b5e-aa63-5c58902de036 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.830317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962436a-743f-4054-9b68-00fbd1f38e89 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.832041 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08961b-cd3c-462e-8c95-4f6cb7a5e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.832891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08961b-cd3c-462e-8c95-4f6cb7a5e393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.833167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08961b-cd3c-462e-8c95-4f6cb7a5e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.833436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08961b-cd3c-462e-8c95-4f6cb7a5e393 admin admin] PATH_INFO: `/v3/projects/6c335ed19ca24bf48b7f68e7347fd5a8/users/47a0688ba4494e5a826e89f26734eaab/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.835504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c3999-c54c-4b26-bf98-a6185d12e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.836291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c3999-c54c-4b26-bf98-a6185d12e557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.836571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c3999-c54c-4b26-bf98-a6185d12e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.836853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c3999-c54c-4b26-bf98-a6185d12e557 admin admin] PATH_INFO: `/v3/projects/bb76045fec614358bd2bb89018436943/users/22de22e8d5964f29b577af216eb3cdd9/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.851159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08961b-cd3c-462e-8c95-4f6cb7a5e393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c335ed19ca24bf48b7f68e7347fd5a8, user_id=47a0688ba4494e5a826e89f26734eaab, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.851949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c3999-c54c-4b26-bf98-a6185d12e557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb76045fec614358bd2bb89018436943, user_id=22de22e8d5964f29b577af216eb3cdd9, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:08.853744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08961b-cd3c-462e-8c95-4f6cb7a5e393 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.854714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c3999-c54c-4b26-bf98-a6185d12e557 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:08.921004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 790/1601] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:08 2022] PUT /identity/v3/projects/bb76045fec614358bd2bb89018436943/users/22de22e8d5964f29b577af216eb3cdd9/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:08.922231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c3999-c54c-4b26-bf98-a6185d12e557 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.934193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 812/1602] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:08 2022] PUT /identity/v3/projects/6c335ed19ca24bf48b7f68e7347fd5a8/users/47a0688ba4494e5a826e89f26734eaab/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:08.934193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08961b-cd3c-462e-8c95-4f6cb7a5e393 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:08.989952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c3999-c54c-4b26-bf98-a6185d12e557 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:08.994657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc8038-8087-4409-ad79-8a4682958f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:08.995547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8038-8087-4409-ad79-8a4682958f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:08.995829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8038-8087-4409-ad79-8a4682958f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:08.996231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8038-8087-4409-ad79-8a4682958f7f admin admin] PATH_INFO: `/v3/projects/128c3a6cd9824d27bc3d7bc1465a798e/users/92d67af8b69d40c88b6453b10e5ab18e/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:08.997295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08961b-cd3c-462e-8c95-4f6cb7a5e393 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.006572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dc6b9-17ce-4aa0-b057-cecb9714bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.007529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dc6b9-17ce-4aa0-b057-cecb9714bc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.008462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dc6b9-17ce-4aa0-b057-cecb9714bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.008462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dc6b9-17ce-4aa0-b057-cecb9714bc39 admin admin] PATH_INFO: `/v3/projects/9703f082240542aa979c6b53052d77b9/users/911ef817a1ee4790ad97e857a299fb01/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.012093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc8038-8087-4409-ad79-8a4682958f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=128c3a6cd9824d27bc3d7bc1465a798e, user_id=92d67af8b69d40c88b6453b10e5ab18e, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.014797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc8038-8087-4409-ad79-8a4682958f7f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.024821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dc6b9-17ce-4aa0-b057-cecb9714bc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9703f082240542aa979c6b53052d77b9, user_id=911ef817a1ee4790ad97e857a299fb01, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.027665 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dc6b9-17ce-4aa0-b057-cecb9714bc39 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.145277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 813/1603] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:08 2022] PUT /identity/v3/projects/9703f082240542aa979c6b53052d77b9/users/911ef817a1ee4790ad97e857a299fb01/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:09.147646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dc6b9-17ce-4aa0-b057-cecb9714bc39 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:09.153084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 791/1604] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:08 2022] PUT /identity/v3/projects/128c3a6cd9824d27bc3d7bc1465a798e/users/92d67af8b69d40c88b6453b10e5ab18e/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:09.153084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc8038-8087-4409-ad79-8a4682958f7f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:09.218742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc8038-8087-4409-ad79-8a4682958f7f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.223822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69f62f-8426-4d9e-abf1-99b856025c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.224766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f62f-8426-4d9e-abf1-99b856025c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.225044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f62f-8426-4d9e-abf1-99b856025c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.225358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f62f-8426-4d9e-abf1-99b856025c62 admin admin] PATH_INFO: `/v3/projects/d9e6651102514605a4f2e00efbdfe387/users/42d7679a0ae046d7abec7c0dd0985fcf/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.226963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dc6b9-17ce-4aa0-b057-cecb9714bc39 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.232249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a2a11-97bc-4867-b492-7bcb17a5a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.233148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a2a11-97bc-4867-b492-7bcb17a5a4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.233576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a2a11-97bc-4867-b492-7bcb17a5a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.234074 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a2a11-97bc-4867-b492-7bcb17a5a4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.235029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a2a11-97bc-4867-b492-7bcb17a5a4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.236958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a2a11-97bc-4867-b492-7bcb17a5a4ce admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.241002 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69f62f-8426-4d9e-abf1-99b856025c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e6651102514605a4f2e00efbdfe387, user_id=42d7679a0ae046d7abec7c0dd0985fcf, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.243755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69f62f-8426-4d9e-abf1-99b856025c62 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.248442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 814/1605] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:09.250042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb59f80-9ff1-4fb2-a641-4c9e20a1fa51 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.250350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb59f80-9ff1-4fb2-a641-4c9e20a1fa51 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.250625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb59f80-9ff1-4fb2-a641-4c9e20a1fa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.268055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8fb59f80-9ff1-4fb2-a641-4c9e20a1fa51 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:09.269725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8fb59f80-9ff1-4fb2-a641-4c9e20a1fa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:09.277341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 815/1606] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:09.278621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c041d3-d6f1-405c-9625-b9b855b7b370 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.278904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c041d3-d6f1-405c-9625-b9b855b7b370 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.279174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c041d3-d6f1-405c-9625-b9b855b7b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.307283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-59c041d3-d6f1-405c-9625-b9b855b7b370 None None] MFA Rules not processed for user `47a0688ba4494e5a826e89f26734eaab`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:09.308490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-59c041d3-d6f1-405c-9625-b9b855b7b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:09.321160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 792/1607] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:09 2022] PUT /identity/v3/projects/d9e6651102514605a4f2e00efbdfe387/users/42d7679a0ae046d7abec7c0dd0985fcf/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:09.322790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357a46-42fa-45bd-989c-eff54f60790c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.323079 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357a46-42fa-45bd-989c-eff54f60790c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.323996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357a46-42fa-45bd-989c-eff54f60790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.366250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-13357a46-42fa-45bd-989c-eff54f60790c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:09.369026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-13357a46-42fa-45bd-989c-eff54f60790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:09.398049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 816/1608] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:09.400034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8a677-81d6-4b31-8a45-02a38d3b3ce2 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.400329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8a677-81d6-4b31-8a45-02a38d3b3ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.400609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8a677-81d6-4b31-8a45-02a38d3b3ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.420294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-00c8a677-81d6-4b31-8a45-02a38d3b3ce2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:09.421522 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-00c8a677-81d6-4b31-8a45-02a38d3b3ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:09.457299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 793/1609] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:09.457299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13357a46-42fa-45bd-989c-eff54f60790c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:09.466594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13357a46-42fa-45bd-989c-eff54f60790c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.472655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d1e0-3c69-4267-b0bf-24ce047e7615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.473702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d1e0-3c69-4267-b0bf-24ce047e7615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.473981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d1e0-3c69-4267-b0bf-24ce047e7615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.474280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72d1e0-3c69-4267-b0bf-24ce047e7615 admin admin] PATH_INFO: `/v3/projects/90d6577ce87048b8a200cae13ba583bf/users/c17e7a311e75431aad2b7128c77d0cd8/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.489546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 817/1610] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:09.491144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8a677-81d6-4b31-8a45-02a38d3b3ce2 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:09.492666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72d1e0-3c69-4267-b0bf-24ce047e7615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d6577ce87048b8a200cae13ba583bf, user_id=c17e7a311e75431aad2b7128c77d0cd8, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.492814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-00c8a677-81d6-4b31-8a45-02a38d3b3ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:09.496384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72d1e0-3c69-4267-b0bf-24ce047e7615 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.549032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8a677-81d6-4b31-8a45-02a38d3b3ce2 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.553209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d527969-6965-4a0a-877e-96b4f782fb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.553855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d527969-6965-4a0a-877e-96b4f782fb62 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.554166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d527969-6965-4a0a-877e-96b4f782fb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.556837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d527969-6965-4a0a-877e-96b4f782fb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.563370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d527969-6965-4a0a-877e-96b4f782fb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.564799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d527969-6965-4a0a-877e-96b4f782fb62 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.574921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 818/1611] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:09.580400 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af058c3d-3234-42aa-a659-16e91bcf58c9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.580712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af058c3d-3234-42aa-a659-16e91bcf58c9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.580997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af058c3d-3234-42aa-a659-16e91bcf58c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.607950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-af058c3d-3234-42aa-a659-16e91bcf58c9 None None] MFA Rules not processed for user `42d7679a0ae046d7abec7c0dd0985fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:09.609456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-af058c3d-3234-42aa-a659-16e91bcf58c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:09.613006 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 794/1612] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:09 2022] PUT /identity/v3/projects/90d6577ce87048b8a200cae13ba583bf/users/c17e7a311e75431aad2b7128c77d0cd8/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:09.613980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d1e0-3c69-4267-b0bf-24ce047e7615 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:09.676385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72d1e0-3c69-4267-b0bf-24ce047e7615 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.680738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 819/1613] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:09.680738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af058c3d-3234-42aa-a659-16e91bcf58c9 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:09.684535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466a895-f96b-40b1-9099-1a2bd491e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.685229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466a895-f96b-40b1-9099-1a2bd491e18b admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.685529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466a895-f96b-40b1-9099-1a2bd491e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.685776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466a895-f96b-40b1-9099-1a2bd491e18b admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.686547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466a895-f96b-40b1-9099-1a2bd491e18b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.688443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466a895-f96b-40b1-9099-1a2bd491e18b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.736524 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af058c3d-3234-42aa-a659-16e91bcf58c9 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.740943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04a7c7-72f8-4dff-bfae-c6b524cc6097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.741645 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04a7c7-72f8-4dff-bfae-c6b524cc6097 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.741924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04a7c7-72f8-4dff-bfae-c6b524cc6097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.742240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04a7c7-72f8-4dff-bfae-c6b524cc6097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.751320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04a7c7-72f8-4dff-bfae-c6b524cc6097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.753335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04a7c7-72f8-4dff-bfae-c6b524cc6097 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.762942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 820/1614] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:09.768920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04a7c7-72f8-4dff-bfae-c6b524cc6097 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:09.771404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04a7c7-72f8-4dff-bfae-c6b524cc6097 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.775800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a890a1-8034-466c-a9bf-042f9349f395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.776439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a890a1-8034-466c-a9bf-042f9349f395 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.776722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a890a1-8034-466c-a9bf-042f9349f395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.776995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a890a1-8034-466c-a9bf-042f9349f395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.788829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a890a1-8034-466c-a9bf-042f9349f395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.790738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a890a1-8034-466c-a9bf-042f9349f395 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.796111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 795/1615] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:09 2022] POST /identity/v3/projects => generated 403 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:09.800503 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0870d5-efcf-4da3-8035-100de052071a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.800503 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0870d5-efcf-4da3-8035-100de052071a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.800503 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0870d5-efcf-4da3-8035-100de052071a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.805927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 821/1616] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:09.806802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a890a1-8034-466c-a9bf-042f9349f395 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:09.817996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a890a1-8034-466c-a9bf-042f9349f395 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.830734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ec0870d5-efcf-4da3-8035-100de052071a None None] MFA Rules not processed for user `c17e7a311e75431aad2b7128c77d0cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:09.832126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ec0870d5-efcf-4da3-8035-100de052071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:09.880957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023800a-64ba-451a-8d19-137ae791e674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.881635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023800a-64ba-451a-8d19-137ae791e674 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.881915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023800a-64ba-451a-8d19-137ae791e674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.884509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023800a-64ba-451a-8d19-137ae791e674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.884509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023800a-64ba-451a-8d19-137ae791e674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.885266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023800a-64ba-451a-8d19-137ae791e674 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:09.907684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 796/1617] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:09.907684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0870d5-efcf-4da3-8035-100de052071a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:09.917212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0870d5-efcf-4da3-8035-100de052071a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:09.922558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665fd09-855d-455b-8244-b90847643638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:09.923248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665fd09-855d-455b-8244-b90847643638 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:09.923536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665fd09-855d-455b-8244-b90847643638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:09.923844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665fd09-855d-455b-8244-b90847643638 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:09.925375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665fd09-855d-455b-8244-b90847643638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:09.927404 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665fd09-855d-455b-8244-b90847643638 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.029998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 797/1618] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:09 2022] POST /identity/v3/users => generated 308 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:10.030836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 822/1619] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:09 2022] POST /identity/v3/projects => generated 381 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:10.031625 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665fd09-855d-455b-8244-b90847643638 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.033504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023800a-64ba-451a-8d19-137ae791e674 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.058198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665fd09-855d-455b-8244-b90847643638 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.117761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023800a-64ba-451a-8d19-137ae791e674 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.123459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f74ec3-3caa-4e0b-90f0-90dfb75606af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.124166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f74ec3-3caa-4e0b-90f0-90dfb75606af admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.124449 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f74ec3-3caa-4e0b-90f0-90dfb75606af admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.124726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f74ec3-3caa-4e0b-90f0-90dfb75606af admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.125463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f74ec3-3caa-4e0b-90f0-90dfb75606af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.127566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f74ec3-3caa-4e0b-90f0-90dfb75606af admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.136861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8eea8-74e9-4362-96f7-3b4456972667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.141968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8eea8-74e9-4362-96f7-3b4456972667 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.142137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 823/1620] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:15:10.142231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8eea8-74e9-4362-96f7-3b4456972667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.142231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8eea8-74e9-4362-96f7-3b4456972667 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.142404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f74ec3-3caa-4e0b-90f0-90dfb75606af admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.142482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8eea8-74e9-4362-96f7-3b4456972667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.143126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8eea8-74e9-4362-96f7-3b4456972667 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.149842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f74ec3-3caa-4e0b-90f0-90dfb75606af admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.161533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae6052-797f-40fa-b299-8b9bc16314b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.162334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae6052-797f-40fa-b299-8b9bc16314b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.162631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae6052-797f-40fa-b299-8b9bc16314b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.162913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae6052-797f-40fa-b299-8b9bc16314b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.163779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae6052-797f-40fa-b299-8b9bc16314b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.166259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae6052-797f-40fa-b299-8b9bc16314b3 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.253851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 824/1621] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:10 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:10.256260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae6052-797f-40fa-b299-8b9bc16314b3 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.257234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 798/1622] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:10 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:10.258332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8eea8-74e9-4362-96f7-3b4456972667 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.280216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae6052-797f-40fa-b299-8b9bc16314b3 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.339486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8eea8-74e9-4362-96f7-3b4456972667 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.345154 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50381c-b6f0-4351-ab3b-91e2e17aa619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.345841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50381c-b6f0-4351-ab3b-91e2e17aa619 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.349213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50381c-b6f0-4351-ab3b-91e2e17aa619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.349523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50381c-b6f0-4351-ab3b-91e2e17aa619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.350353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50381c-b6f0-4351-ab3b-91e2e17aa619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.352465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50381c-b6f0-4351-ab3b-91e2e17aa619 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.364335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae4313-b258-4642-b485-9e6e18343bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.366204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 799/1623] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:10.366204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50381c-b6f0-4351-ab3b-91e2e17aa619 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.366443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae4313-b258-4642-b485-9e6e18343bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.366443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae4313-b258-4642-b485-9e6e18343bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.366648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae4313-b258-4642-b485-9e6e18343bf1 admin admin] PATH_INFO: `/v3/projects/04b2467623944db5b5cab0db27e937fe/users/7aaa52504dac4e49a4ccc8d58e423a73/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.377802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50381c-b6f0-4351-ab3b-91e2e17aa619 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.384110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b971117-7c50-4b1f-97ac-7cf1252c0b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.385100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b971117-7c50-4b1f-97ac-7cf1252c0b2c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.385486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b971117-7c50-4b1f-97ac-7cf1252c0b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.385865 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b971117-7c50-4b1f-97ac-7cf1252c0b2c admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.389587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b971117-7c50-4b1f-97ac-7cf1252c0b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.402611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae4313-b258-4642-b485-9e6e18343bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b2467623944db5b5cab0db27e937fe, user_id=7aaa52504dac4e49a4ccc8d58e423a73, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.403827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b971117-7c50-4b1f-97ac-7cf1252c0b2c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.406893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae4313-b258-4642-b485-9e6e18343bf1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.501531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 800/1624] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:10 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:10.507558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b971117-7c50-4b1f-97ac-7cf1252c0b2c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.507879 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 825/1625] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:10 2022] PUT /identity/v3/projects/04b2467623944db5b5cab0db27e937fe/users/7aaa52504dac4e49a4ccc8d58e423a73/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:10.509924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae4313-b258-4642-b485-9e6e18343bf1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.522164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b971117-7c50-4b1f-97ac-7cf1252c0b2c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.614626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae4313-b258-4642-b485-9e6e18343bf1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.618426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd00a0-b184-4e73-8106-729752b721b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.618426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd00a0-b184-4e73-8106-729752b721b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.620568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd00a0-b184-4e73-8106-729752b721b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.620869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd00a0-b184-4e73-8106-729752b721b4 admin admin] PATH_INFO: `/v3/projects/e90c465d2fe64f97951e0a66ef5038a1/users/0a6b07b803aa4da9873ff56becb6f878/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.623681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07598f2-6960-49bb-a3be-c5898f8c02a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.624697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07598f2-6960-49bb-a3be-c5898f8c02a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.625696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07598f2-6960-49bb-a3be-c5898f8c02a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.628299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07598f2-6960-49bb-a3be-c5898f8c02a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.629412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07598f2-6960-49bb-a3be-c5898f8c02a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.632346 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07598f2-6960-49bb-a3be-c5898f8c02a7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.638563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd00a0-b184-4e73-8106-729752b721b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90c465d2fe64f97951e0a66ef5038a1, user_id=0a6b07b803aa4da9873ff56becb6f878, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.641586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd00a0-b184-4e73-8106-729752b721b4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.649383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 826/1626] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:10.653419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07598f2-6960-49bb-a3be-c5898f8c02a7 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.667128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07598f2-6960-49bb-a3be-c5898f8c02a7 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.674397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e439df-b4c8-4fa9-a14b-be4411439d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.675327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e439df-b4c8-4fa9-a14b-be4411439d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.675829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e439df-b4c8-4fa9-a14b-be4411439d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.676324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e439df-b4c8-4fa9-a14b-be4411439d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.677389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e439df-b4c8-4fa9-a14b-be4411439d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.681964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e439df-b4c8-4fa9-a14b-be4411439d16 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.706220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 827/1627] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:10.708073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e439df-b4c8-4fa9-a14b-be4411439d16 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.722262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e439df-b4c8-4fa9-a14b-be4411439d16 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.730746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38a41-442d-4f92-9834-8cb6f7b6e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.733960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38a41-442d-4f92-9834-8cb6f7b6e0da admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.734542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38a41-442d-4f92-9834-8cb6f7b6e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.734924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d38a41-442d-4f92-9834-8cb6f7b6e0da admin admin] PATH_INFO: `/v3/projects/98df2580ce514440840c9c2353329f54/users/e2ce9e1c16474095be96ac1a7b373fcd/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.741798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 801/1628] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:10 2022] PUT /identity/v3/projects/e90c465d2fe64f97951e0a66ef5038a1/users/0a6b07b803aa4da9873ff56becb6f878/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:10.744800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd00a0-b184-4e73-8106-729752b721b4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.759656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38a41-442d-4f92-9834-8cb6f7b6e0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=98df2580ce514440840c9c2353329f54, user_id=e2ce9e1c16474095be96ac1a7b373fcd, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.763214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d38a41-442d-4f92-9834-8cb6f7b6e0da admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.848838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd00a0-b184-4e73-8106-729752b721b4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:10.856077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17324816-f636-420e-a797-cef14717dc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:10.857436 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17324816-f636-420e-a797-cef14717dc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:10.857775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17324816-f636-420e-a797-cef14717dc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:10.858079 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17324816-f636-420e-a797-cef14717dc89 admin admin] PATH_INFO: `/v3/projects/04b2467623944db5b5cab0db27e937fe/users/7aaa52504dac4e49a4ccc8d58e423a73/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:10.861018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17324816-f636-420e-a797-cef14717dc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b2467623944db5b5cab0db27e937fe, user_id=7aaa52504dac4e49a4ccc8d58e423a73, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:10.861624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 828/1629] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:10 2022] PUT /identity/v3/projects/98df2580ce514440840c9c2353329f54/users/e2ce9e1c16474095be96ac1a7b373fcd/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:10.865284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17324816-f636-420e-a797-cef14717dc89 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:10.866977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38a41-442d-4f92-9834-8cb6f7b6e0da admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:10.880012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 802/1630] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:10 2022] PUT /identity/v3/projects/04b2467623944db5b5cab0db27e937fe/users/7aaa52504dac4e49a4ccc8d58e423a73/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:10.880981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17324816-f636-420e-a797-cef14717dc89 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:11.001375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d38a41-442d-4f92-9834-8cb6f7b6e0da admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:11.037600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17324816-f636-420e-a797-cef14717dc89 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:11.061854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913816f-b77e-4704-8822-f0ed9361e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:11.061854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913816f-b77e-4704-8822-f0ed9361e5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.061854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913816f-b77e-4704-8822-f0ed9361e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.061854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913816f-b77e-4704-8822-f0ed9361e5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.062386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913816f-b77e-4704-8822-f0ed9361e5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:11.062386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913816f-b77e-4704-8822-f0ed9361e5a2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:11.090958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 803/1631] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:11.094200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4802-b5ed-4fbb-ae9d-d0a18daf489b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.094508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4802-b5ed-4fbb-ae9d-d0a18daf489b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.094789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e4802-b5ed-4fbb-ae9d-d0a18daf489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.146194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0af5b-7e6c-431c-a73c-852ac2ac4d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:11.149592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0af5b-7e6c-431c-a73c-852ac2ac4d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.149904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0af5b-7e6c-431c-a73c-852ac2ac4d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.150214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0af5b-7e6c-431c-a73c-852ac2ac4d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.152834 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0af5b-7e6c-431c-a73c-852ac2ac4d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:11.157450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0af5b-7e6c-431c-a73c-852ac2ac4d02 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:11.170530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2b6e4802-b5ed-4fbb-ae9d-d0a18daf489b None None] MFA Rules not processed for user `7aaa52504dac4e49a4ccc8d58e423a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:11.172504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2b6e4802-b5ed-4fbb-ae9d-d0a18daf489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:11.183763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 829/1632] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:11.186890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0af5b-7e6c-431c-a73c-852ac2ac4d02 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:11.210015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0af5b-7e6c-431c-a73c-852ac2ac4d02 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:11.222500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239fd35-1a88-46eb-b79d-277f3d976b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:11.224004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239fd35-1a88-46eb-b79d-277f3d976b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.224337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239fd35-1a88-46eb-b79d-277f3d976b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.224621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239fd35-1a88-46eb-b79d-277f3d976b0d admin admin] PATH_INFO: `/v3/projects/98df2580ce514440840c9c2353329f54/users/e2ce9e1c16474095be96ac1a7b373fcd/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.230928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239fd35-1a88-46eb-b79d-277f3d976b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98df2580ce514440840c9c2353329f54, user_id=e2ce9e1c16474095be96ac1a7b373fcd, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:11.236192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239fd35-1a88-46eb-b79d-277f3d976b0d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:11.272175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 830/1633] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:11 2022] PUT /identity/v3/projects/98df2580ce514440840c9c2353329f54/users/e2ce9e1c16474095be96ac1a7b373fcd/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:11.274292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239fd35-1a88-46eb-b79d-277f3d976b0d admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:11.345329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 804/1634] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:11.348281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b2ae-d2d2-4a9a-8161-ab3a48716624 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.348281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b2ae-d2d2-4a9a-8161-ab3a48716624 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.348281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b2ae-d2d2-4a9a-8161-ab3a48716624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.406122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a482b2ae-d2d2-4a9a-8161-ab3a48716624 None None] MFA Rules not processed for user `e2ce9e1c16474095be96ac1a7b373fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:11.412825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239fd35-1a88-46eb-b79d-277f3d976b0d admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:11.413336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a482b2ae-d2d2-4a9a-8161-ab3a48716624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:11.420203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84255e73-47fc-4e4d-9ce7-0757d6ac091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:11.422236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255e73-47fc-4e4d-9ce7-0757d6ac091c admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.422536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255e73-47fc-4e4d-9ce7-0757d6ac091c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.422869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255e73-47fc-4e4d-9ce7-0757d6ac091c admin admin] PATH_INFO: `/v3/projects/e90c465d2fe64f97951e0a66ef5038a1/users/0a6b07b803aa4da9873ff56becb6f878/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.425945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84255e73-47fc-4e4d-9ce7-0757d6ac091c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90c465d2fe64f97951e0a66ef5038a1, user_id=0a6b07b803aa4da9873ff56becb6f878, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:11.430511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84255e73-47fc-4e4d-9ce7-0757d6ac091c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:11.455553 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 831/1635] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:11 2022] PUT /identity/v3/projects/e90c465d2fe64f97951e0a66ef5038a1/users/0a6b07b803aa4da9873ff56becb6f878/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:11.456618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84255e73-47fc-4e4d-9ce7-0757d6ac091c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:11.526605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84255e73-47fc-4e4d-9ce7-0757d6ac091c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:11.531497 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6974c-52c2-4f54-a85d-7aada0edb67f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:11.532231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6974c-52c2-4f54-a85d-7aada0edb67f service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.532604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6974c-52c2-4f54-a85d-7aada0edb67f service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.532946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6974c-52c2-4f54-a85d-7aada0edb67f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.555529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 805/1636] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:11 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:11.557464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6082f-a5f8-4795-937a-c3bed67e3b29 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.557756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6082f-a5f8-4795-937a-c3bed67e3b29 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.558089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6082f-a5f8-4795-937a-c3bed67e3b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.602316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-63d6082f-a5f8-4795-937a-c3bed67e3b29 None None] MFA Rules not processed for user `0a6b07b803aa4da9873ff56becb6f878`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:11.604245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-63d6082f-a5f8-4795-937a-c3bed67e3b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:11.621056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6974c-52c2-4f54-a85d-7aada0edb67f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:11.623252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6974c-52c2-4f54-a85d-7aada0edb67f service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:11.652210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 832/1637] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:11 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:11.653487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6974c-52c2-4f54-a85d-7aada0edb67f service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:11.670544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6974c-52c2-4f54-a85d-7aada0edb67f service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:11.690915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186afa38-4f41-47da-a5a7-b9b1ac6b8136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:11.694199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186afa38-4f41-47da-a5a7-b9b1ac6b8136 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.696109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186afa38-4f41-47da-a5a7-b9b1ac6b8136 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.697221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186afa38-4f41-47da-a5a7-b9b1ac6b8136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.729742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 806/1638] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:11.751771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6082f-a5f8-4795-937a-c3bed67e3b29 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:11.763413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6082f-a5f8-4795-937a-c3bed67e3b29 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:11.779419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573ff4e-bf57-4930-a1f4-5dcb88ec1ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:11.780151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573ff4e-bf57-4930-a1f4-5dcb88ec1ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:11.780428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573ff4e-bf57-4930-a1f4-5dcb88ec1ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:11.780696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573ff4e-bf57-4930-a1f4-5dcb88ec1ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:11.802190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573ff4e-bf57-4930-a1f4-5dcb88ec1ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:11.804440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573ff4e-bf57-4930-a1f4-5dcb88ec1ae1 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:11.811231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186afa38-4f41-47da-a5a7-b9b1ac6b8136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:11.812862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186afa38-4f41-47da-a5a7-b9b1ac6b8136 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:11.828536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 807/1639] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:15:11.832648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 833/1640] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:11 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:12.178887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573ff4e-bf57-4930-a1f4-5dcb88ec1ae1 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:12.189425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573ff4e-bf57-4930-a1f4-5dcb88ec1ae1 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:12.194119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964892d-0ed6-4763-94ff-c9c1e8386977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:12.194970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964892d-0ed6-4763-94ff-c9c1e8386977 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:12.195357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964892d-0ed6-4763-94ff-c9c1e8386977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:12.195732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964892d-0ed6-4763-94ff-c9c1e8386977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:12.236077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bf140-00f6-4a1c-a1ae-07b115130bb6 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:12.236516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bf140-00f6-4a1c-a1ae-07b115130bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:12.236908 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bf140-00f6-4a1c-a1ae-07b115130bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:12.280195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964892d-0ed6-4763-94ff-c9c1e8386977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:12.287718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964892d-0ed6-4763-94ff-c9c1e8386977 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:12.296521 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ce2bf140-00f6-4a1c-a1ae-07b115130bb6 None None] MFA Rules not processed for user `92d67af8b69d40c88b6453b10e5ab18e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:12.297882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ce2bf140-00f6-4a1c-a1ae-07b115130bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:12.308504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 808/1641] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:12.396472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 834/1642] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:12.397207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964892d-0ed6-4763-94ff-c9c1e8386977 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:12.434530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bf140-00f6-4a1c-a1ae-07b115130bb6 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:12.534372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bf140-00f6-4a1c-a1ae-07b115130bb6 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:12.541177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964892d-0ed6-4763-94ff-c9c1e8386977 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:12.541898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:12.541898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:12.541898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:12.541898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] PATH_INFO: `/v3/users/47a0688ba4494e5a826e89f26734eaab` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:12.548102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a0688ba4494e5a826e89f26734eaab)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:12.550151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:12.553114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e89f1-ccfd-438b-8f37-b6b1fb0f034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:12.553828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e89f1-ccfd-438b-8f37-b6b1fb0f034a admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:12.554127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e89f1-ccfd-438b-8f37-b6b1fb0f034a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:12.554403 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e89f1-ccfd-438b-8f37-b6b1fb0f034a admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:12.555099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e89f1-ccfd-438b-8f37-b6b1fb0f034a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:12.557076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e89f1-ccfd-438b-8f37-b6b1fb0f034a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:12.697894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 809/1643] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:12 2022] POST /identity/v3/projects => generated 405 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:15:12.701194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e89f1-ccfd-438b-8f37-b6b1fb0f034a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:12.795712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e89f1-ccfd-438b-8f37-b6b1fb0f034a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:12.805125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a34e4-50bd-4cb5-8d9a-037b0e9d722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:12.806106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a34e4-50bd-4cb5-8d9a-037b0e9d722c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:12.806557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a34e4-50bd-4cb5-8d9a-037b0e9d722c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:12.807058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a34e4-50bd-4cb5-8d9a-037b0e9d722c admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:12.808038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a34e4-50bd-4cb5-8d9a-037b0e9d722c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:12.810516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a34e4-50bd-4cb5-8d9a-037b0e9d722c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:12.890484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a0688ba4494e5a826e89f26734eaab'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:12.891563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a0688ba4494e5a826e89f26734eaab'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:12.892197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a0688ba4494e5a826e89f26734eaab'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:12.933815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 810/1644] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:12 2022] POST /identity/v3/users => generated 309 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:12.934501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b42d0e-43e7-4802-8cae-4477b69c757f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:12.936562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b42d0e-43e7-4802-8cae-4477b69c757f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:12.936562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b42d0e-43e7-4802-8cae-4477b69c757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:12.965551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a0688ba4494e5a826e89f26734eaab'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:12.992726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a0688ba4494e5a826e89f26734eaab'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:13.046432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-93b42d0e-43e7-4802-8cae-4477b69c757f None None] MFA Rules not processed for user `22de22e8d5964f29b577af216eb3cdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:13.048453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-93b42d0e-43e7-4802-8cae-4477b69c757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:13.124016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 835/1645] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:12 2022] DELETE /identity/v3/users/47a0688ba4494e5a826e89f26734eaab => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:13.124016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:13.128827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:13.256173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5dd50-c5b6-4227-98d5-d8670f9b6289 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:13.270133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 811/1646] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:13.275176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb922c90-1e9e-430a-8224-083312201724 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:13.275575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb922c90-1e9e-430a-8224-083312201724 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:13.275864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb922c90-1e9e-430a-8224-083312201724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:13.284173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97812814-0f31-4923-85cc-d8f1b3c62c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:13.285001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97812814-0f31-4923-85cc-d8f1b3c62c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:13.288602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97812814-0f31-4923-85cc-d8f1b3c62c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:13.288602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97812814-0f31-4923-85cc-d8f1b3c62c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:13.289213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97812814-0f31-4923-85cc-d8f1b3c62c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:13.293230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97812814-0f31-4923-85cc-d8f1b3c62c06 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:13.329194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cb922c90-1e9e-430a-8224-083312201724 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:13.329194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cb922c90-1e9e-430a-8224-083312201724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:13.347611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 836/1647] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:13.352585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 812/1648] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:13.352982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb922c90-1e9e-430a-8224-083312201724 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:13.357600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6d256-7867-4324-8a0c-84cc1e080795 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:13.357953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6d256-7867-4324-8a0c-84cc1e080795 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:13.358324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6d256-7867-4324-8a0c-84cc1e080795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:13.393027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb922c90-1e9e-430a-8224-083312201724 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:13.398500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e2c6-35df-4a8d-ac04-28d079183e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:13.399591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-fad6d256-7867-4324-8a0c-84cc1e080795 None None] MFA Rules not processed for user `22de22e8d5964f29b577af216eb3cdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:13.399821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e2c6-35df-4a8d-ac04-28d079183e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:13.400222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e2c6-35df-4a8d-ac04-28d079183e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:13.400591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e2c6-35df-4a8d-ac04-28d079183e22 admin admin] PATH_INFO: `/v3/projects/a2e329a4e0fb471eb09efaa25a0ac9c8/users/b07375daa3bd4e44b7744db105c4450f/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:13.400809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fad6d256-7867-4324-8a0c-84cc1e080795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:13.458815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5e2c6-35df-4a8d-ac04-28d079183e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e329a4e0fb471eb09efaa25a0ac9c8, user_id=b07375daa3bd4e44b7744db105c4450f, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:13.472346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5e2c6-35df-4a8d-ac04-28d079183e22 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:13.567743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 837/1649] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:13.568808 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6d256-7867-4324-8a0c-84cc1e080795 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:13.570285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fad6d256-7867-4324-8a0c-84cc1e080795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:13.585182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 813/1650] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:13 2022] PUT /identity/v3/projects/a2e329a4e0fb471eb09efaa25a0ac9c8/users/b07375daa3bd4e44b7744db105c4450f/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:13.593369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e2c6-35df-4a8d-ac04-28d079183e22 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:13.662439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6d256-7867-4324-8a0c-84cc1e080795 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:13.721655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e2c6-35df-4a8d-ac04-28d079183e22 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:13.730532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0333c4-1a4d-4c9a-9ca2-deae328dc64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:13.731229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0333c4-1a4d-4c9a-9ca2-deae328dc64a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:13.731510 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0333c4-1a4d-4c9a-9ca2-deae328dc64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:13.731783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0333c4-1a4d-4c9a-9ca2-deae328dc64a admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:13.733006 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0333c4-1a4d-4c9a-9ca2-deae328dc64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:13.735544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0333c4-1a4d-4c9a-9ca2-deae328dc64a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:13.746822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedd8c3-2bcd-47e8-9b11-6be387c1bdd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:13.747982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedd8c3-2bcd-47e8-9b11-6be387c1bdd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:13.748477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedd8c3-2bcd-47e8-9b11-6be387c1bdd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:13.749188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedd8c3-2bcd-47e8-9b11-6be387c1bdd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:13.756506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 814/1651] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:13.756717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b535df3-6ad3-4948-a1ba-5cb77d3e09c5 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:13.757456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b535df3-6ad3-4948-a1ba-5cb77d3e09c5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:14.060979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b535df3-6ad3-4948-a1ba-5cb77d3e09c5 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:14.060979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 815/1652] 10.222.0.44 () {54 vars in 961 bytes} [Mon May 16 15:15:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:14.060979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b535df3-6ad3-4948-a1ba-5cb77d3e09c5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:14.062312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedd8c3-2bcd-47e8-9b11-6be387c1bdd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:14.062312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedd8c3-2bcd-47e8-9b11-6be387c1bdd4 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:14.063368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b535df3-6ad3-4948-a1ba-5cb77d3e09c5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:14.063368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbad6f-77fe-4b64-a495-ba53078b7ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:14.063368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbad6f-77fe-4b64-a495-ba53078b7ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:14.063368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbad6f-77fe-4b64-a495-ba53078b7ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:14.064269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbad6f-77fe-4b64-a495-ba53078b7ade admin admin] PATH_INFO: `/v3/projects/a2e329a4e0fb471eb09efaa25a0ac9c8/users/b07375daa3bd4e44b7744db105c4450f/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:14.064269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbad6f-77fe-4b64-a495-ba53078b7ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e329a4e0fb471eb09efaa25a0ac9c8, user_id=b07375daa3bd4e44b7744db105c4450f, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:14.064269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbad6f-77fe-4b64-a495-ba53078b7ade admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:14.065586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 838/1653] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:14.065586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea804c8-c5f7-4e24-956a-e3412de48add None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:14.065586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea804c8-c5f7-4e24-956a-e3412de48add None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:14.065586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea804c8-c5f7-4e24-956a-e3412de48add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:14.067725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 816/1654] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:13 2022] PUT /identity/v3/projects/a2e329a4e0fb471eb09efaa25a0ac9c8/users/b07375daa3bd4e44b7744db105c4450f/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:14.068098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3ea804c8-c5f7-4e24-956a-e3412de48add None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:14.068098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3ea804c8-c5f7-4e24-956a-e3412de48add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:14.068098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 839/1655] 10.222.0.44 () {58 vars in 1058 bytes} [Mon May 16 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:14.069552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbad6f-77fe-4b64-a495-ba53078b7ade admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:14.069552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbad6f-77fe-4b64-a495-ba53078b7ade admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:14.069552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bf6c9-82f1-448c-aca1-ba146beba879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:14.069552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bf6c9-82f1-448c-aca1-ba146beba879 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:14.070426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bf6c9-82f1-448c-aca1-ba146beba879 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:14.070426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bf6c9-82f1-448c-aca1-ba146beba879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:14.070728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea804c8-c5f7-4e24-956a-e3412de48add None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:14.070728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3ea804c8-c5f7-4e24-956a-e3412de48add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:14.133560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bf6c9-82f1-448c-aca1-ba146beba879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:14.135237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bf6c9-82f1-448c-aca1-ba146beba879 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:14.144225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea804c8-c5f7-4e24-956a-e3412de48add None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:14.153896 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:14.155916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:14.156422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:14.157063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] PATH_INFO: `/v3/users/c17e7a311e75431aad2b7128c77d0cd8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:14.158747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17e7a311e75431aad2b7128c77d0cd8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:14.159373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 817/1656] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:14.161782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:14.546695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17e7a311e75431aad2b7128c77d0cd8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:14.548876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17e7a311e75431aad2b7128c77d0cd8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:14.549766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17e7a311e75431aad2b7128c77d0cd8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:14.570604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17e7a311e75431aad2b7128c77d0cd8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:14.581478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d262c81a-f8ee-43d9-817d-1f212ae952fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17e7a311e75431aad2b7128c77d0cd8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:14.679738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 840/1657] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:13 2022] DELETE /identity/v3/users/c17e7a311e75431aad2b7128c77d0cd8 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:14.685551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d58ccd-6b84-41f9-848e-911dce59e86a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:14.686749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d58ccd-6b84-41f9-848e-911dce59e86a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:14.687033 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d58ccd-6b84-41f9-848e-911dce59e86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:14.723652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a3d58ccd-6b84-41f9-848e-911dce59e86a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:14.725168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a3d58ccd-6b84-41f9-848e-911dce59e86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:14.810689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c9b48-d555-4cb2-9e16-9135c75901a4 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:14.811199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c9b48-d555-4cb2-9e16-9135c75901a4 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:14.811496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c9b48-d555-4cb2-9e16-9135c75901a4 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:14.813352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 841/1658] 10.222.0.44 () {54 vars in 912 bytes} [Mon May 16 15:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:14.820799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f937f8-2c40-45bc-92c3-e9399773d036 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:14.821103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f937f8-2c40-45bc-92c3-e9399773d036 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:14.821573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f937f8-2c40-45bc-92c3-e9399773d036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:14.883719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-b9f937f8-2c40-45bc-92c3-e9399773d036 None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:14.885057 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b9f937f8-2c40-45bc-92c3-e9399773d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:14.933250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 818/1659] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:14.942882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d58ccd-6b84-41f9-848e-911dce59e86a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:14.946088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a3d58ccd-6b84-41f9-848e-911dce59e86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:15.066956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 842/1660] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:15:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:15.068010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f937f8-2c40-45bc-92c3-e9399773d036 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:15.082166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b9f937f8-2c40-45bc-92c3-e9399773d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:15.130304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f937f8-2c40-45bc-92c3-e9399773d036 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:15.142378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d58ccd-6b84-41f9-848e-911dce59e86a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:15.147819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:15.149305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:15.149588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:15.149865 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] PATH_INFO: `/v3/projects/6c335ed19ca24bf48b7f68e7347fd5a8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:15.152776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c335ed19ca24bf48b7f68e7347fd5a8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:15.153818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: WARNING py.warnings [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:15:15.153818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: warnings.warn(msg) May 16 15:15:15.153818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: May 16 15:15:15.155063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:15.162010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15933a-e406-4861-b22c-2fa379c19ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:15.162809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15933a-e406-4861-b22c-2fa379c19ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:15.163095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15933a-e406-4861-b22c-2fa379c19ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:15.163455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15933a-e406-4861-b22c-2fa379c19ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:15.199530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15933a-e406-4861-b22c-2fa379c19ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:15.201008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15933a-e406-4861-b22c-2fa379c19ab6 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:15.234006 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 819/1661] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:15:15.234963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15933a-e406-4861-b22c-2fa379c19ab6 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:15.242820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2a15933a-e406-4861-b22c-2fa379c19ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:15.359685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15933a-e406-4861-b22c-2fa379c19ab6 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:15.364151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef264-1ce0-4034-80f6-fa50dd4b4bbd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9237b353da546989b399ee9702d1bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:15.365150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef264-1ce0-4034-80f6-fa50dd4b4bbd service glance] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:15.366270 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef264-1ce0-4034-80f6-fa50dd4b4bbd service glance] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:15.366737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef264-1ce0-4034-80f6-fa50dd4b4bbd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:15.381593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ef264-1ce0-4034-80f6-fa50dd4b4bbd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:15.383768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ef264-1ce0-4034-80f6-fa50dd4b4bbd service glance] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:15.428184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 820/1662] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:15.451812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c335ed19ca24bf48b7f68e7347fd5a8', 'request_id': 'req-366c8527-be5f-428b-9d97-c17b90856b2b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:15.536794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c335ed19ca24bf48b7f68e7347fd5a8', 'request_id': 'req-366c8527-be5f-428b-9d97-c17b90856b2b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:15.544951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c335ed19ca24bf48b7f68e7347fd5a8', 'request_id': 'req-366c8527-be5f-428b-9d97-c17b90856b2b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:15.599856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] The token cache is being invalidate because project 6c335ed19ca24bf48b7f68e7347fd5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:15.606870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:15.607938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-366c8527-be5f-428b-9d97-c17b90856b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:15.610134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 843/1663] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:15 2022] DELETE /identity/v3/projects/6c335ed19ca24bf48b7f68e7347fd5a8 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:15.615033 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef264-1ce0-4034-80f6-fa50dd4b4bbd service glance] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:15.635060 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef264-1ce0-4034-80f6-fa50dd4b4bbd service glance] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:15.840721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:15.843542 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:15.843832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:15.844110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] PATH_INFO: `/v3/users/7aaa52504dac4e49a4ccc8d58e423a73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:15.855269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aaa52504dac4e49a4ccc8d58e423a73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:15.855269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 15:15:15.855269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: warnings.warn(msg) May 16 15:15:15.855269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: May 16 15:15:15.855269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:16.169743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aaa52504dac4e49a4ccc8d58e423a73'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:16.173433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aaa52504dac4e49a4ccc8d58e423a73'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:16.262461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aaa52504dac4e49a4ccc8d58e423a73'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:16.268472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aaa52504dac4e49a4ccc8d58e423a73'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:16.318694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-af81973c-0f73-482a-a7a3-c920ba8fdf6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aaa52504dac4e49a4ccc8d58e423a73'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:16.444024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 821/1664] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:15 2022] DELETE /identity/v3/users/7aaa52504dac4e49a4ccc8d58e423a73 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:16.665358 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75043103-40ea-40a9-b9dd-2d792e45fae6 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:16.665925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75043103-40ea-40a9-b9dd-2d792e45fae6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:16.665925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75043103-40ea-40a9-b9dd-2d792e45fae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:16.697482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-75043103-40ea-40a9-b9dd-2d792e45fae6 None None] MFA Rules not processed for user `b07375daa3bd4e44b7744db105c4450f`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:16.699166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-75043103-40ea-40a9-b9dd-2d792e45fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:16.862016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 844/1665] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:17.228963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86c5c-d3e4-46bf-ad8d-3a882b239dd2 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:17.229407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86c5c-d3e4-46bf-ad8d-3a882b239dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:17.229490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd86c5c-d3e4-46bf-ad8d-3a882b239dd2 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:17.231240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 822/1666] 10.222.0.44 () {54 vars in 912 bytes} [Mon May 16 15:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:17.238603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7553e87-1822-4919-96b9-cb987a438dc0 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:17.239137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7553e87-1822-4919-96b9-cb987a438dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:17.239692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7553e87-1822-4919-96b9-cb987a438dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:17.370749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d7553e87-1822-4919-96b9-cb987a438dc0 None None] MFA Rules not processed for user `aec8440b7bd84c2b9ce583a01adabf90`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:17.371956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d7553e87-1822-4919-96b9-cb987a438dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:17.510257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 845/1667] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:15:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:17.735842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd86c5c-d3e4-46bf-ad8d-3a882b239dd2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:17.737862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0fd86c5c-d3e4-46bf-ad8d-3a882b239dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:17.759077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd86c5c-d3e4-46bf-ad8d-3a882b239dd2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:17.772518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4007cc1-7470-46a4-b432-d7883b98b113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:17.773381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4007cc1-7470-46a4-b432-d7883b98b113 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:17.773798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4007cc1-7470-46a4-b432-d7883b98b113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:17.774230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4007cc1-7470-46a4-b432-d7883b98b113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:17.788407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4007cc1-7470-46a4-b432-d7883b98b113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:17.790979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4007cc1-7470-46a4-b432-d7883b98b113 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:17.810980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 823/1668] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:18.786978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7553e87-1822-4919-96b9-cb987a438dc0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:18.788428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d7553e87-1822-4919-96b9-cb987a438dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:18.945383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7553e87-1822-4919-96b9-cb987a438dc0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:18.955539 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:18.957562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:18.958118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:18.958601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] PATH_INFO: `/v3/projects/90d6577ce87048b8a200cae13ba583bf` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:18.959997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d6577ce87048b8a200cae13ba583bf)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:18.962147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:19.006080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4007cc1-7470-46a4-b432-d7883b98b113 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:19.007540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a4007cc1-7470-46a4-b432-d7883b98b113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:19.059336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4007cc1-7470-46a4-b432-d7883b98b113 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:19.076378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:19.077254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:19.077536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:19.077809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] PATH_INFO: `/v3/projects/04b2467623944db5b5cab0db27e937fe` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:19.084505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b2467623944db5b5cab0db27e937fe)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:19.084938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:19.221037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d6577ce87048b8a200cae13ba583bf', 'request_id': 'req-af60e7c6-4712-4b18-8fe8-aaeb6edec701'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.287908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b2467623944db5b5cab0db27e937fe', 'request_id': 'req-a8a7e84c-8de2-46b2-a326-511f2f26073b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.309126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d6577ce87048b8a200cae13ba583bf', 'request_id': 'req-af60e7c6-4712-4b18-8fe8-aaeb6edec701'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.311410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b2467623944db5b5cab0db27e937fe', 'request_id': 'req-a8a7e84c-8de2-46b2-a326-511f2f26073b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.318244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d6577ce87048b8a200cae13ba583bf', 'request_id': 'req-af60e7c6-4712-4b18-8fe8-aaeb6edec701'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.336939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b2467623944db5b5cab0db27e937fe', 'request_id': 'req-a8a7e84c-8de2-46b2-a326-511f2f26073b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.351746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] The token cache is being invalidate because project 90d6577ce87048b8a200cae13ba583bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:19.352088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.353515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-af60e7c6-4712-4b18-8fe8-aaeb6edec701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.355436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 846/1669] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:18 2022] DELETE /identity/v3/projects/90d6577ce87048b8a200cae13ba583bf => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:19.356745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015c2a-5a54-472e-ab32-b6865b690a17 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:19.357036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015c2a-5a54-472e-ab32-b6865b690a17 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:19.357309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015c2a-5a54-472e-ab32-b6865b690a17 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:19.359574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 847/1670] 10.222.0.44 () {54 vars in 960 bytes} [Mon May 16 15:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:19.360526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f015c2a-5a54-472e-ab32-b6865b690a17 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:19.369669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5f015c2a-5a54-472e-ab32-b6865b690a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:19.429575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] The token cache is being invalidate because project 04b2467623944db5b5cab0db27e937fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:19.429869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.430622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8a7e84c-8de2-46b2-a326-511f2f26073b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.436030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 824/1671] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:19 2022] DELETE /identity/v3/projects/04b2467623944db5b5cab0db27e937fe => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:19.442399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e043b-9ade-40b6-ba80-7d369a41b62e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:19.442399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e043b-9ade-40b6-ba80-7d369a41b62e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:19.442399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e043b-9ade-40b6-ba80-7d369a41b62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:19.460536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5d9e043b-9ade-40b6-ba80-7d369a41b62e None None] MFA Rules not processed for user `6dfdb39ae2804b2191cea53f2a387c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:19.462193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5d9e043b-9ade-40b6-ba80-7d369a41b62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:19.600678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f015c2a-5a54-472e-ab32-b6865b690a17 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:19.614897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:19.615796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:19.616076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:19.616350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] PATH_INFO: `/v3/users/e2ce9e1c16474095be96ac1a7b373fcd` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:19.618047 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 825/1672] 10.222.0.44 () {58 vars in 1057 bytes} [Mon May 16 15:15:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:19.618837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ce9e1c16474095be96ac1a7b373fcd)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:19.620753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eac21-120f-435b-b570-71870e300f51 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:19.620871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:19.621361 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eac21-120f-435b-b570-71870e300f51 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:19.621840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4eac21-120f-435b-b570-71870e300f51 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:19.624523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 826/1673] 10.222.0.44 () {54 vars in 961 bytes} [Mon May 16 15:15:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:19.627910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb05a7-95b4-44b3-85d3-f552744b607c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:19.628434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb05a7-95b4-44b3-85d3-f552744b607c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:19.628928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb05a7-95b4-44b3-85d3-f552744b607c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:19.695194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-edcb05a7-95b4-44b3-85d3-f552744b607c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:19.712844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-edcb05a7-95b4-44b3-85d3-f552744b607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:19.740843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 827/1674] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:19.742320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb05a7-95b4-44b3-85d3-f552744b607c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:19.789640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb05a7-95b4-44b3-85d3-f552744b607c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:19.802812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50652662-6d70-43c4-a71b-70dbf6d9352c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dfdb39ae2804b2191cea53f2a387c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:19.806256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652662-6d70-43c4-a71b-70dbf6d9352c service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:19.810989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652662-6d70-43c4-a71b-70dbf6d9352c service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:19.810989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652662-6d70-43c4-a71b-70dbf6d9352c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:19.818268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-50652662-6d70-43c4-a71b-70dbf6d9352c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:19.855509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ce9e1c16474095be96ac1a7b373fcd'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.868196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ce9e1c16474095be96ac1a7b373fcd'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.872824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ce9e1c16474095be96ac1a7b373fcd'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.875498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50652662-6d70-43c4-a71b-70dbf6d9352c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:19.878354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50652662-6d70-43c4-a71b-70dbf6d9352c service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:19.907654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 828/1675] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:19.909882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1bd0d-a42d-4727-b8fe-52a59ebbe093 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:19.910203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1bd0d-a42d-4727-b8fe-52a59ebbe093 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:19.910485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1bd0d-a42d-4727-b8fe-52a59ebbe093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:19.931434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ce9e1c16474095be96ac1a7b373fcd'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:19.949162 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-10e1bd0d-a42d-4727-b8fe-52a59ebbe093 None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:19.954653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-10e1bd0d-a42d-4727-b8fe-52a59ebbe093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:19.963410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d62d10c-58d9-4059-91a6-4c97e2582344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ce9e1c16474095be96ac1a7b373fcd'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:20.052029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 848/1676] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:19 2022] DELETE /identity/v3/users/e2ce9e1c16474095be96ac1a7b373fcd => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:20.056423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6fae0-875b-4fc4-a5df-82cba5441e04 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:20.056709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6fae0-875b-4fc4-a5df-82cba5441e04 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:20.056983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6fae0-875b-4fc4-a5df-82cba5441e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:20.091279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 829/1677] 10.222.0.44 () {58 vars in 1058 bytes} [Mon May 16 15:15:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:20.096638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84277d-ccc4-49ed-894b-22e1ee3e70f7 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:20.097010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84277d-ccc4-49ed-894b-22e1ee3e70f7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:20.097368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84277d-ccc4-49ed-894b-22e1ee3e70f7 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:20.104162 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 830/1678] 10.222.0.44 () {54 vars in 912 bytes} [Mon May 16 15:15:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:20.109992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c224c7-bf1d-47fc-b4c7-6a25a054bfeb None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:20.110438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c224c7-bf1d-47fc-b4c7-6a25a054bfeb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:20.110898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c224c7-bf1d-47fc-b4c7-6a25a054bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:20.127415 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-69e6fae0-875b-4fc4-a5df-82cba5441e04 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:20.136326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-69e6fae0-875b-4fc4-a5df-82cba5441e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:20.137609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b6c224c7-bf1d-47fc-b4c7-6a25a054bfeb None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:20.139679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b6c224c7-bf1d-47fc-b4c7-6a25a054bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:20.257235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 831/1679] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:20.295404 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c224c7-bf1d-47fc-b4c7-6a25a054bfeb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:20.297520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b6c224c7-bf1d-47fc-b4c7-6a25a054bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:20.345907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 849/1680] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:20.350393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6fae0-875b-4fc4-a5df-82cba5441e04 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:20.380060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6fae0-875b-4fc4-a5df-82cba5441e04 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:20.389692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682c14e-19bd-4617-8397-a7fbf153e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:20.394199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682c14e-19bd-4617-8397-a7fbf153e6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:20.394486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682c14e-19bd-4617-8397-a7fbf153e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:20.396409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682c14e-19bd-4617-8397-a7fbf153e6fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:20.397176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682c14e-19bd-4617-8397-a7fbf153e6fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:20.397538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682c14e-19bd-4617-8397-a7fbf153e6fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:20.399247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682c14e-19bd-4617-8397-a7fbf153e6fd admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:20.428852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 850/1681] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:20.430182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682c14e-19bd-4617-8397-a7fbf153e6fd admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:20.438363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c224c7-bf1d-47fc-b4c7-6a25a054bfeb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:20.445373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682c14e-19bd-4617-8397-a7fbf153e6fd admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:20.447150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d83f03-8a95-436f-8e98-b83d71745ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:20.448166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d83f03-8a95-436f-8e98-b83d71745ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:20.448449 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d83f03-8a95-436f-8e98-b83d71745ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:20.449620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d83f03-8a95-436f-8e98-b83d71745ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:20.454293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2783474-1971-40cc-84a6-607fa77ac534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:20.455909 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2783474-1971-40cc-84a6-607fa77ac534 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:20.456467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2783474-1971-40cc-84a6-607fa77ac534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:20.456993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2783474-1971-40cc-84a6-607fa77ac534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:20.458095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2783474-1971-40cc-84a6-607fa77ac534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:20.460979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2783474-1971-40cc-84a6-607fa77ac534 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:20.474740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d83f03-8a95-436f-8e98-b83d71745ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:20.476193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d83f03-8a95-436f-8e98-b83d71745ae7 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:20.504874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 832/1682] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:20.596436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 851/1683] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:20 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:20.599546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d83f03-8a95-436f-8e98-b83d71745ae7 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:20.610956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d83f03-8a95-436f-8e98-b83d71745ae7 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:20.699462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b81f1a-dd4f-4801-b776-42ba942778ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:20.700367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b81f1a-dd4f-4801-b776-42ba942778ea admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:20.700657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b81f1a-dd4f-4801-b776-42ba942778ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:20.700932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b81f1a-dd4f-4801-b776-42ba942778ea admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:20.701657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b81f1a-dd4f-4801-b776-42ba942778ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:20.708700 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b81f1a-dd4f-4801-b776-42ba942778ea admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:20.814597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 833/1684] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:20 2022] POST /identity/v3/users => generated 282 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:20.818354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2783474-1971-40cc-84a6-607fa77ac534 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:20.839474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2783474-1971-40cc-84a6-607fa77ac534 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:20.847613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac71ae-eef4-4d4c-ae78-59263527ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:20.849545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac71ae-eef4-4d4c-ae78-59263527ad1e admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:20.850021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac71ae-eef4-4d4c-ae78-59263527ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:20.850568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac71ae-eef4-4d4c-ae78-59263527ad1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:20.851593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac71ae-eef4-4d4c-ae78-59263527ad1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:20.855271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac71ae-eef4-4d4c-ae78-59263527ad1e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:20.871185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 852/1685] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:20.875474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b81f1a-dd4f-4801-b776-42ba942778ea admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:20.905104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b81f1a-dd4f-4801-b776-42ba942778ea admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:20.963361 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206064ac-deb7-4cb9-87d4-3f4f8f966e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:20.965840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206064ac-deb7-4cb9-87d4-3f4f8f966e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:20.966191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206064ac-deb7-4cb9-87d4-3f4f8f966e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:20.966486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206064ac-deb7-4cb9-87d4-3f4f8f966e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:20.972630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206064ac-deb7-4cb9-87d4-3f4f8f966e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:20.981958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206064ac-deb7-4cb9-87d4-3f4f8f966e54 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:21.016898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 834/1686] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:21.018386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac71ae-eef4-4d4c-ae78-59263527ad1e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:21.037175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac71ae-eef4-4d4c-ae78-59263527ad1e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:21.055294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebb6be-e8c8-416e-8abe-05c6efaf15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:21.069141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebb6be-e8c8-416e-8abe-05c6efaf15ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:21.071256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebb6be-e8c8-416e-8abe-05c6efaf15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:21.071475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebb6be-e8c8-416e-8abe-05c6efaf15ab admin admin] PATH_INFO: `/v3/projects/991ae24cf98248cc9456b13700b2e16d/users/3d8405189360405f980ede24024f2059/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:21.135822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebb6be-e8c8-416e-8abe-05c6efaf15ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=991ae24cf98248cc9456b13700b2e16d, user_id=3d8405189360405f980ede24024f2059, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:21.146195 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebb6be-e8c8-416e-8abe-05c6efaf15ab admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:21.236932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 853/1687] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:21 2022] PUT /identity/v3/projects/991ae24cf98248cc9456b13700b2e16d/users/3d8405189360405f980ede24024f2059/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:21.247246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37406a1-772a-4870-b52a-07d55ba57793 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:21.247745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37406a1-772a-4870-b52a-07d55ba57793 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:21.248133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37406a1-772a-4870-b52a-07d55ba57793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:21.302582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b37406a1-772a-4870-b52a-07d55ba57793 None None] MFA Rules not processed for user `3d8405189360405f980ede24024f2059`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:21.303810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b37406a1-772a-4870-b52a-07d55ba57793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:21.354241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebb6be-e8c8-416e-8abe-05c6efaf15ab admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:21.357735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a3ebb6be-e8c8-416e-8abe-05c6efaf15ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:21.403282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 835/1688] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:21.403453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37406a1-772a-4870-b52a-07d55ba57793 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:21.496714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37406a1-772a-4870-b52a-07d55ba57793 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:21.503655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f43c39-c95c-4852-84c8-797102576080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:21.504648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f43c39-c95c-4852-84c8-797102576080 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:21.505313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f43c39-c95c-4852-84c8-797102576080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:21.505729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f43c39-c95c-4852-84c8-797102576080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:21.507832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f43c39-c95c-4852-84c8-797102576080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:21.510681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f43c39-c95c-4852-84c8-797102576080 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:21.614946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebb6be-e8c8-416e-8abe-05c6efaf15ab admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:21.626621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:21.627512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:21.627983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:21.628268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] PATH_INFO: `/v3/projects/98df2580ce514440840c9c2353329f54` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:21.632580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98df2580ce514440840c9c2353329f54)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:21.635102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:21.683545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 836/1689] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:21 2022] POST /identity/v3/projects => generated 361 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:21.686558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f43c39-c95c-4852-84c8-797102576080 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:21.831463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98df2580ce514440840c9c2353329f54', 'request_id': 'req-55d66961-23cb-44fb-a1a2-4a2735ccf95b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:21.884458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f43c39-c95c-4852-84c8-797102576080 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:21.924952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98df2580ce514440840c9c2353329f54', 'request_id': 'req-55d66961-23cb-44fb-a1a2-4a2735ccf95b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:21.931574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98df2580ce514440840c9c2353329f54', 'request_id': 'req-55d66961-23cb-44fb-a1a2-4a2735ccf95b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:21.962509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] The token cache is being invalidate because project 98df2580ce514440840c9c2353329f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:21.962791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:21.972265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-55d66961-23cb-44fb-a1a2-4a2735ccf95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:21.974012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 854/1690] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:21 2022] DELETE /identity/v3/projects/98df2580ce514440840c9c2353329f54 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:21.982514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911bf3d-f651-45f2-9063-d069075bafdc None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:21.983863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911bf3d-f651-45f2-9063-d069075bafdc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:21.985167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911bf3d-f651-45f2-9063-d069075bafdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.045603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-0911bf3d-f651-45f2-9063-d069075bafdc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:22.046891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0911bf3d-f651-45f2-9063-d069075bafdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:22.050799 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db314ff3-5b04-4d65-9ba0-807798566db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:22.051499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db314ff3-5b04-4d65-9ba0-807798566db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:22.051783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db314ff3-5b04-4d65-9ba0-807798566db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:22.052059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db314ff3-5b04-4d65-9ba0-807798566db3 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.067478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db314ff3-5b04-4d65-9ba0-807798566db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:22.067478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db314ff3-5b04-4d65-9ba0-807798566db3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:22.091658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 855/1691] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:22.096375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f1121-64f4-43eb-b748-4660f45474e4 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:22.096375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f1121-64f4-43eb-b748-4660f45474e4 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:22.096375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f1121-64f4-43eb-b748-4660f45474e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.125566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-b91f1121-64f4-43eb-b748-4660f45474e4 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:22.125566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b91f1121-64f4-43eb-b748-4660f45474e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:22.142699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 856/1692] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:22.147858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f1121-64f4-43eb-b748-4660f45474e4 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:22.171698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f1121-64f4-43eb-b748-4660f45474e4 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:22.178845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eca79-4e21-4151-a1f8-e49127532dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:22.179777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eca79-4e21-4151-a1f8-e49127532dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:22.180202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eca79-4e21-4151-a1f8-e49127532dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:22.180643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eca79-4e21-4151-a1f8-e49127532dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.181543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eca79-4e21-4151-a1f8-e49127532dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:22.181993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eca79-4e21-4151-a1f8-e49127532dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:22.183921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eca79-4e21-4151-a1f8-e49127532dbc admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:22.199495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 857/1693] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:22.203924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eca79-4e21-4151-a1f8-e49127532dbc admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:22.235982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 837/1694] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:21 2022] POST /identity/v3/users => generated 287 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:22.236149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eca79-4e21-4151-a1f8-e49127532dbc admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:22.236231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db314ff3-5b04-4d65-9ba0-807798566db3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:22.237282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-db314ff3-5b04-4d65-9ba0-807798566db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:22.264750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abe10a-743a-4f16-9c4d-62ed275b3fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:22.265459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abe10a-743a-4f16-9c4d-62ed275b3fed admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:22.265746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abe10a-743a-4f16-9c4d-62ed275b3fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:22.266028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abe10a-743a-4f16-9c4d-62ed275b3fed admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.266787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abe10a-743a-4f16-9c4d-62ed275b3fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:22.282977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abe10a-743a-4f16-9c4d-62ed275b3fed admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:22.286699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db314ff3-5b04-4d65-9ba0-807798566db3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:22.319583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544770e-907d-4696-9069-a7ec40bb0323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:22.323860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544770e-907d-4696-9069-a7ec40bb0323 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:22.324235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544770e-907d-4696-9069-a7ec40bb0323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:22.324517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544770e-907d-4696-9069-a7ec40bb0323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.325315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544770e-907d-4696-9069-a7ec40bb0323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:22.331834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544770e-907d-4696-9069-a7ec40bb0323 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:22.358543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 838/1695] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:22.359967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3c207-5f9c-4bf8-9eb6-006474fbeda6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:22.360315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3c207-5f9c-4bf8-9eb6-006474fbeda6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:22.360597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3c207-5f9c-4bf8-9eb6-006474fbeda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.394227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-08a3c207-5f9c-4bf8-9eb6-006474fbeda6 None None] MFA Rules not processed for user `a14795cb97ac44b2a7fc1e2f79b12253`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:22.395706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-08a3c207-5f9c-4bf8-9eb6-006474fbeda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:22.461622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 858/1696] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:22 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:22.462904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abe10a-743a-4f16-9c4d-62ed275b3fed admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:22.521081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 839/1697] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:22.534492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3c207-5f9c-4bf8-9eb6-006474fbeda6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:22.586039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3c207-5f9c-4bf8-9eb6-006474fbeda6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:22.618092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abe10a-743a-4f16-9c4d-62ed275b3fed admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:22.632912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3220e46-c27c-4207-ad8f-abd609656147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:22.694713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3220e46-c27c-4207-ad8f-abd609656147 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:22.694998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3220e46-c27c-4207-ad8f-abd609656147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:22.695268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3220e46-c27c-4207-ad8f-abd609656147 admin admin] PATH_INFO: `/v3/projects/ebb569ed838844218ec6199c871f404b/users/cd17761108b74a6aa3b63861d9c56d15/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.752169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3220e46-c27c-4207-ad8f-abd609656147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb569ed838844218ec6199c871f404b, user_id=cd17761108b74a6aa3b63861d9c56d15, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:22.756338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3220e46-c27c-4207-ad8f-abd609656147 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:22.808842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62a41b-1833-4cc3-9808-9389a17c81ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:22.809538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62a41b-1833-4cc3-9808-9389a17c81ca admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:22.809876 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62a41b-1833-4cc3-9808-9389a17c81ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:22.810206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62a41b-1833-4cc3-9808-9389a17c81ca admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.811082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62a41b-1833-4cc3-9808-9389a17c81ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:22.814006 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62a41b-1833-4cc3-9808-9389a17c81ca admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:22.883491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 859/1698] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:22 2022] PUT /identity/v3/projects/ebb569ed838844218ec6199c871f404b/users/cd17761108b74a6aa3b63861d9c56d15/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:22.885419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b1590-2eef-4bdf-8491-1ece2ad22ede None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:22.889268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b1590-2eef-4bdf-8491-1ece2ad22ede None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:22.889268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b1590-2eef-4bdf-8491-1ece2ad22ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:22.946939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 840/1699] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:22 2022] POST /identity/v3/users => generated 293 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:22.951320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62a41b-1833-4cc3-9808-9389a17c81ca admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:22.957935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fc62a41b-1833-4cc3-9808-9389a17c81ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:22.967409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-451b1590-2eef-4bdf-8491-1ece2ad22ede None None] MFA Rules not processed for user `a14795cb97ac44b2a7fc1e2f79b12253`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:22.968672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-451b1590-2eef-4bdf-8491-1ece2ad22ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:23.006140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62a41b-1833-4cc3-9808-9389a17c81ca admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:23.129581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 860/1700] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:23.131254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b1590-2eef-4bdf-8491-1ece2ad22ede None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:23.165142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:23.166035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:23.166368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:23.166646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] PATH_INFO: `/v3/users/92d67af8b69d40c88b6453b10e5ab18e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:23.168623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d67af8b69d40c88b6453b10e5ab18e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:23.170684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:23.335235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b1590-2eef-4bdf-8491-1ece2ad22ede None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:23.351052 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105c08-3b0f-4567-a312-b937caeaa57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:23.351744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105c08-3b0f-4567-a312-b937caeaa57b admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:23.352124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105c08-3b0f-4567-a312-b937caeaa57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:23.352301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105c08-3b0f-4567-a312-b937caeaa57b admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:23.353033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f105c08-3b0f-4567-a312-b937caeaa57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:23.359778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f105c08-3b0f-4567-a312-b937caeaa57b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:23.424229 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 861/1701] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:23.426131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105c08-3b0f-4567-a312-b937caeaa57b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:23.426718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d67af8b69d40c88b6453b10e5ab18e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:23.427507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d67af8b69d40c88b6453b10e5ab18e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:23.444679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d67af8b69d40c88b6453b10e5ab18e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:23.445857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d67af8b69d40c88b6453b10e5ab18e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:23.449714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105c08-3b0f-4567-a312-b937caeaa57b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:23.458468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d67af8b69d40c88b6453b10e5ab18e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:23.465158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ccdd0-5d3e-47b2-b56a-4b073a74fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:23.465823 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ccdd0-5d3e-47b2-b56a-4b073a74fb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:23.466187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ccdd0-5d3e-47b2-b56a-4b073a74fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:23.466400 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ccdd0-5d3e-47b2-b56a-4b073a74fb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:23.467143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ccdd0-5d3e-47b2-b56a-4b073a74fb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:23.469805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ccdd0-5d3e-47b2-b56a-4b073a74fb03 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:23.486727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 862/1702] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:23.493616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2ed6-0cbb-4728-ab06-4a51dacb1f95 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:23.494143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2ed6-0cbb-4728-ab06-4a51dacb1f95 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:23.494603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2ed6-0cbb-4728-ab06-4a51dacb1f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:23.543697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 841/1703] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:22 2022] DELETE /identity/v3/users/92d67af8b69d40c88b6453b10e5ab18e => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:23.544982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:23.550163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:23.563508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-87eb2ed6-0cbb-4728-ab06-4a51dacb1f95 None None] MFA Rules not processed for user `44ffd5660baa40a7a3d6918cb5d31e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:23.565186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-87eb2ed6-0cbb-4728-ab06-4a51dacb1f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:23.719185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 863/1704] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:23.724423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb2ed6-0cbb-4728-ab06-4a51dacb1f95 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:23.729812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-87eb2ed6-0cbb-4728-ab06-4a51dacb1f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:23.806395 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75d7b0-4241-4560-a9a5-3b45d6a4f560 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:23.821091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:23.821507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:23.821798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:23.822152 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:23.826555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:23.856130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb2ed6-0cbb-4728-ab06-4a51dacb1f95 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:23.863575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d890f0-daf6-4954-aec1-3c1e247229cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:23.864552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d890f0-daf6-4954-aec1-3c1e247229cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:23.864838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d890f0-daf6-4954-aec1-3c1e247229cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:23.869919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d890f0-daf6-4954-aec1-3c1e247229cf admin admin] PATH_INFO: `/v3/projects/ebb569ed838844218ec6199c871f404b/users/cd17761108b74a6aa3b63861d9c56d15/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:23.869919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d890f0-daf6-4954-aec1-3c1e247229cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb569ed838844218ec6199c871f404b, user_id=cd17761108b74a6aa3b63861d9c56d15, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:23.870242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d890f0-daf6-4954-aec1-3c1e247229cf admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:23.883975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 864/1705] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:23 2022] PUT /identity/v3/projects/ebb569ed838844218ec6199c871f404b/users/cd17761108b74a6aa3b63861d9c56d15/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:23.884968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d890f0-daf6-4954-aec1-3c1e247229cf admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:23.886868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e0d890f0-daf6-4954-aec1-3c1e247229cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:23.986110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:23.988150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:24.016075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 842/1706] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:24.018898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:24.021255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:24.038928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab894f2-893e-4fa0-b3e1-a54edfa92fac service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:24.083474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d890f0-daf6-4954-aec1-3c1e247229cf admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:24.099270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968c2a4-7eb5-47f6-bbd8-756b0c5b70a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:24.099989 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968c2a4-7eb5-47f6-bbd8-756b0c5b70a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:24.100291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968c2a4-7eb5-47f6-bbd8-756b0c5b70a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:24.100555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968c2a4-7eb5-47f6-bbd8-756b0c5b70a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:24.101298 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968c2a4-7eb5-47f6-bbd8-756b0c5b70a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:24.102960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968c2a4-7eb5-47f6-bbd8-756b0c5b70a6 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:24.130963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 865/1707] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:24.132585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f22a20-020b-49ff-b26c-a2c7e8429dad None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:24.132878 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f22a20-020b-49ff-b26c-a2c7e8429dad None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:24.133154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f22a20-020b-49ff-b26c-a2c7e8429dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:24.165314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28817-55aa-4c4e-bbb5-de2361c118dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:24.165999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28817-55aa-4c4e-bbb5-de2361c118dc service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:24.166346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28817-55aa-4c4e-bbb5-de2361c118dc service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:24.166636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28817-55aa-4c4e-bbb5-de2361c118dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:24.194770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-46f22a20-020b-49ff-b26c-a2c7e8429dad None None] MFA Rules not processed for user `cd17761108b74a6aa3b63861d9c56d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:24.196385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-46f22a20-020b-49ff-b26c-a2c7e8429dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:24.267948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a28817-55aa-4c4e-bbb5-de2361c118dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:24.269557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a28817-55aa-4c4e-bbb5-de2361c118dc service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:24.280548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 843/1708] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:24.281922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28817-55aa-4c4e-bbb5-de2361c118dc service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:24.283748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-42a28817-55aa-4c4e-bbb5-de2361c118dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:24.315965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28817-55aa-4c4e-bbb5-de2361c118dc service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:24.337111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:24.340076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 866/1709] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:24.340660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:24.341296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f22a20-020b-49ff-b26c-a2c7e8429dad None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:24.341701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:24.342832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] PATH_INFO: `/v3/projects/128c3a6cd9824d27bc3d7bc1465a798e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:24.346852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] RBAC: Authorizing `identity:delete_project(project_id=128c3a6cd9824d27bc3d7bc1465a798e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:24.355678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:24.372951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f22a20-020b-49ff-b26c-a2c7e8429dad None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:24.387933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de925509-416e-471b-aff1-b3115202ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:24.391144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de925509-416e-471b-aff1-b3115202ab39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:24.391538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de925509-416e-471b-aff1-b3115202ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:24.397131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de925509-416e-471b-aff1-b3115202ab39 admin admin] PATH_INFO: `/v3/projects/782e18c7424c4d15b1cd20519830fe65/users/a1916f6b316249268ed1513110154ae3/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:24.427435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de925509-416e-471b-aff1-b3115202ab39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782e18c7424c4d15b1cd20519830fe65, user_id=a1916f6b316249268ed1513110154ae3, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:24.432502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de925509-416e-471b-aff1-b3115202ab39 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:24.638938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 867/1710] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:24 2022] PUT /identity/v3/projects/782e18c7424c4d15b1cd20519830fe65/users/a1916f6b316249268ed1513110154ae3/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:24.638938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de925509-416e-471b-aff1-b3115202ab39 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:24.640754 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-de925509-416e-471b-aff1-b3115202ab39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:24.652112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128c3a6cd9824d27bc3d7bc1465a798e', 'request_id': 'req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:24.681791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128c3a6cd9824d27bc3d7bc1465a798e', 'request_id': 'req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:24.686858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128c3a6cd9824d27bc3d7bc1465a798e', 'request_id': 'req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:24.787492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de925509-416e-471b-aff1-b3115202ab39 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:24.797071 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82c9f3-ef28-4d01-a04e-6e11a7898f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:24.800311 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c9f3-ef28-4d01-a04e-6e11a7898f17 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:24.800865 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c9f3-ef28-4d01-a04e-6e11a7898f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:24.801158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c9f3-ef28-4d01-a04e-6e11a7898f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:24.822765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] The token cache is being invalidate because project 128c3a6cd9824d27bc3d7bc1465a798e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:24.823517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:24.826498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-01b6ba53-f6cb-4fa8-ae0e-e65d5883510e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:24.832401 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 844/1711] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:24 2022] DELETE /identity/v3/projects/128c3a6cd9824d27bc3d7bc1465a798e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:24.833930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3359604-395f-4a2b-a82b-9acd71f87854 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:24.834276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3359604-395f-4a2b-a82b-9acd71f87854 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:24.834550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3359604-395f-4a2b-a82b-9acd71f87854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:24.899256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e3359604-395f-4a2b-a82b-9acd71f87854 None None] MFA Rules not processed for user `a1916f6b316249268ed1513110154ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:24.900789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e3359604-395f-4a2b-a82b-9acd71f87854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:25.020876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82c9f3-ef28-4d01-a04e-6e11a7898f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:25.026973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82c9f3-ef28-4d01-a04e-6e11a7898f17 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:25.045088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 868/1712] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:24 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:25.048691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82c9f3-ef28-4d01-a04e-6e11a7898f17 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:25.057096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 845/1713] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:25.059022 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb077e3-f59d-4e21-8bc9-42896db00778 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:25.060282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb077e3-f59d-4e21-8bc9-42896db00778 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:25.062399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb077e3-f59d-4e21-8bc9-42896db00778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:25.144012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9cb077e3-f59d-4e21-8bc9-42896db00778 None None] MFA Rules not processed for user `911ef817a1ee4790ad97e857a299fb01`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:25.145573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9cb077e3-f59d-4e21-8bc9-42896db00778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:25.204946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82c9f3-ef28-4d01-a04e-6e11a7898f17 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:25.243253 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:25.247639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:25.248027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:25.248448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] PATH_INFO: `/v3/users/b07375daa3bd4e44b7744db105c4450f` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:25.250671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07375daa3bd4e44b7744db105c4450f)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:25.253435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:25.299111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 846/1714] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:25.300277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb077e3-f59d-4e21-8bc9-42896db00778 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:25.315029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9cb077e3-f59d-4e21-8bc9-42896db00778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:25.338973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb077e3-f59d-4e21-8bc9-42896db00778 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:25.344633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afeb74-072d-4a5d-8447-8fa775a9687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:25.345605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afeb74-072d-4a5d-8447-8fa775a9687c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:25.346659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afeb74-072d-4a5d-8447-8fa775a9687c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:25.346962 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afeb74-072d-4a5d-8447-8fa775a9687c admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:25.348048 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afeb74-072d-4a5d-8447-8fa775a9687c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:25.350158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55afeb74-072d-4a5d-8447-8fa775a9687c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:25.460635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 847/1715] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:25 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:25.461713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afeb74-072d-4a5d-8447-8fa775a9687c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:25.466090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-55afeb74-072d-4a5d-8447-8fa775a9687c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:25.549565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07375daa3bd4e44b7744db105c4450f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:25.550952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07375daa3bd4e44b7744db105c4450f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:25.551561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07375daa3bd4e44b7744db105c4450f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:25.598231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07375daa3bd4e44b7744db105c4450f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:25.636215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07375daa3bd4e44b7744db105c4450f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:25.705073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afeb74-072d-4a5d-8447-8fa775a9687c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:25.717923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:25.718643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:25.722886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:25.722886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:25.724063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:25.750538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 869/1716] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:25 2022] DELETE /identity/v3/users/b07375daa3bd4e44b7744db105c4450f => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:25.751444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:25.774393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:25.952286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:25.955574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef487599-370d-4762-9d6c-58efd74f4343 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:25.956790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:25.966857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb867b-becc-416c-afbf-14977c1a6f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:25.967645 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb867b-becc-416c-afbf-14977c1a6f65 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:25.967888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb867b-becc-416c-afbf-14977c1a6f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:25.968149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb867b-becc-416c-afbf-14977c1a6f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:25.973483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8abb867b-becc-416c-afbf-14977c1a6f65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:25.975584 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 848/1717] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:25.976418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:25.979683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:26.181396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb867b-becc-416c-afbf-14977c1a6f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:26.183198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb867b-becc-416c-afbf-14977c1a6f65 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:26.217463 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87d83-55e6-4af4-a27f-dbea38243826 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:26.223106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 870/1718] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:25 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:26.235197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26a205-2c84-40ab-88fc-c2db13baeeb9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:26.235533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26a205-2c84-40ab-88fc-c2db13baeeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:26.235802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26a205-2c84-40ab-88fc-c2db13baeeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:26.318371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ff26a205-2c84-40ab-88fc-c2db13baeeb9 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:26.319954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ff26a205-2c84-40ab-88fc-c2db13baeeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:26.381445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5ff48-1a39-43da-9ba1-4787761a52ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:26.382549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5ff48-1a39-43da-9ba1-4787761a52ea admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:26.382830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5ff48-1a39-43da-9ba1-4787761a52ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:26.383103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5ff48-1a39-43da-9ba1-4787761a52ea admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:26.384098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5ff48-1a39-43da-9ba1-4787761a52ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:26.392441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5ff48-1a39-43da-9ba1-4787761a52ea admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:26.437022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 871/1719] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:15:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:26.439085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f145-c034-4037-9c4f-7f99a7fa2e66 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:26.439372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f145-c034-4037-9c4f-7f99a7fa2e66 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:26.439644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384f145-c034-4037-9c4f-7f99a7fa2e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:26.474503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2384f145-c034-4037-9c4f-7f99a7fa2e66 None None] MFA Rules not processed for user `a14795cb97ac44b2a7fc1e2f79b12253`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:26.476443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2384f145-c034-4037-9c4f-7f99a7fa2e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:26.614002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 872/1720] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:26.627405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 849/1721] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:25 2022] POST /identity/v3/users => generated 293 bytes in 651 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:26.630486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384f145-c034-4037-9c4f-7f99a7fa2e66 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:26.648933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5ff48-1a39-43da-9ba1-4787761a52ea admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:26.654966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-dea5ff48-1a39-43da-9ba1-4787761a52ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:26.673203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384f145-c034-4037-9c4f-7f99a7fa2e66 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:26.689657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5ff48-1a39-43da-9ba1-4787761a52ea admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:26.695352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb2188-3e49-4665-ac05-d2818037609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:26.696919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb2188-3e49-4665-ac05-d2818037609a admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:26.697996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb2188-3e49-4665-ac05-d2818037609a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:26.698492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb2188-3e49-4665-ac05-d2818037609a admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:26.701391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb2188-3e49-4665-ac05-d2818037609a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:26.706994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb2188-3e49-4665-ac05-d2818037609a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:26.707299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:26.708756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:26.708861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:26.711730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] PATH_INFO: `/v3/projects/a2e329a4e0fb471eb09efaa25a0ac9c8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:26.715885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e329a4e0fb471eb09efaa25a0ac9c8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:26.717846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:26.737421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 873/1722] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:26.738466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb2188-3e49-4665-ac05-d2818037609a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:26.767264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb2188-3e49-4665-ac05-d2818037609a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:26.781735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c89f3-86e8-4ec9-8f8e-8a1074dc2d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:26.783772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c89f3-86e8-4ec9-8f8e-8a1074dc2d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:26.783996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c89f3-86e8-4ec9-8f8e-8a1074dc2d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:26.784286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c89f3-86e8-4ec9-8f8e-8a1074dc2d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:26.785533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c89f3-86e8-4ec9-8f8e-8a1074dc2d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:26.787044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c89f3-86e8-4ec9-8f8e-8a1074dc2d0a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:26.840975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 874/1723] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:26.842827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c89f3-86e8-4ec9-8f8e-8a1074dc2d0a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:26.898416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c89f3-86e8-4ec9-8f8e-8a1074dc2d0a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:26.917018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e329a4e0fb471eb09efaa25a0ac9c8', 'request_id': 'req-2d949e7a-03b3-4aea-bd3f-6a30b1706731'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:26.947930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e329a4e0fb471eb09efaa25a0ac9c8', 'request_id': 'req-2d949e7a-03b3-4aea-bd3f-6a30b1706731'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:26.964454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e329a4e0fb471eb09efaa25a0ac9c8', 'request_id': 'req-2d949e7a-03b3-4aea-bd3f-6a30b1706731'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:27.052203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c412-e1de-456d-816b-0e1ef66200db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:27.053487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c412-e1de-456d-816b-0e1ef66200db admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.053487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c412-e1de-456d-816b-0e1ef66200db admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.053650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c412-e1de-456d-816b-0e1ef66200db admin admin] PATH_INFO: `/v3/projects/1913b74800934bffbf10883aa89aee0b/users/510f75c56ece417d9fe683af30ed7d23/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.093985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82c412-e1de-456d-816b-0e1ef66200db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1913b74800934bffbf10883aa89aee0b, user_id=510f75c56ece417d9fe683af30ed7d23, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:27.096856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82c412-e1de-456d-816b-0e1ef66200db admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:27.143050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] The token cache is being invalidate because project a2e329a4e0fb471eb09efaa25a0ac9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:27.143621 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:27.145586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:27.156938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 850/1724] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:26 2022] DELETE /identity/v3/projects/a2e329a4e0fb471eb09efaa25a0ac9c8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:27.164907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:27.174975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:27.211113 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 875/1725] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:26 2022] PUT /identity/v3/projects/1913b74800934bffbf10883aa89aee0b/users/510f75c56ece417d9fe683af30ed7d23/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:27.212536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e186-c601-4cc6-95fc-f3acb5b6734f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.212879 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e186-c601-4cc6-95fc-f3acb5b6734f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.213444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e186-c601-4cc6-95fc-f3acb5b6734f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.264067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8d50e186-c601-4cc6-95fc-f3acb5b6734f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:27.266242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8d50e186-c601-4cc6-95fc-f3acb5b6734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:27.376649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d949e7a-03b3-4aea-bd3f-6a30b1706731 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:27.405745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 876/1726] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:27.407570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314372f-0d11-4829-8bd5-9ed4b9343e0a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.407876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314372f-0d11-4829-8bd5-9ed4b9343e0a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.408326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314372f-0d11-4829-8bd5-9ed4b9343e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.465194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-b314372f-0d11-4829-8bd5-9ed4b9343e0a None None] MFA Rules not processed for user `510f75c56ece417d9fe683af30ed7d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:27.466511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b314372f-0d11-4829-8bd5-9ed4b9343e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:27.470242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caf0b5-c0c0-4f85-b237-832f62d14550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:27.471133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf0b5-c0c0-4f85-b237-832f62d14550 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.471588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf0b5-c0c0-4f85-b237-832f62d14550 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.472034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf0b5-c0c0-4f85-b237-832f62d14550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.474156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-68caf0b5-c0c0-4f85-b237-832f62d14550 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:27.555343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caf0b5-c0c0-4f85-b237-832f62d14550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:27.558296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caf0b5-c0c0-4f85-b237-832f62d14550 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:27.579448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 851/1727] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:15:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:15:27.581700 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca222f2-0109-455b-99e8-c51bf3d949e6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.583216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca222f2-0109-455b-99e8-c51bf3d949e6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.583690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca222f2-0109-455b-99e8-c51bf3d949e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.626522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1ca222f2-0109-455b-99e8-c51bf3d949e6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:27.627439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 877/1728] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:27.628083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1ca222f2-0109-455b-99e8-c51bf3d949e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:27.629561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314372f-0d11-4829-8bd5-9ed4b9343e0a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:27.632497 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b314372f-0d11-4829-8bd5-9ed4b9343e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:27.651152 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 852/1729] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:27.661468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca222f2-0109-455b-99e8-c51bf3d949e6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:27.693238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca222f2-0109-455b-99e8-c51bf3d949e6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:27.711095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e402d-900f-427e-b83e-6676abdd74b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:27.711801 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e402d-900f-427e-b83e-6676abdd74b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.712243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e402d-900f-427e-b83e-6676abdd74b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.712587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e402d-900f-427e-b83e-6676abdd74b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.713448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e402d-900f-427e-b83e-6676abdd74b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:27.719075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e402d-900f-427e-b83e-6676abdd74b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:27.722182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e402d-900f-427e-b83e-6676abdd74b7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:27.757872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314372f-0d11-4829-8bd5-9ed4b9343e0a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:27.759781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 853/1730] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:15:27.760716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e402d-900f-427e-b83e-6676abdd74b7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:27.788529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e402d-900f-427e-b83e-6676abdd74b7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:27.792322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082dc34-ee52-49f8-b950-aed878a3d98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:27.793984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082dc34-ee52-49f8-b950-aed878a3d98b admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.794293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082dc34-ee52-49f8-b950-aed878a3d98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.794571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082dc34-ee52-49f8-b950-aed878a3d98b admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.803890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6efba7-ff5d-4e71-aaf7-2e167bbbb1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:27.804704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6efba7-ff5d-4e71-aaf7-2e167bbbb1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:27.805099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6efba7-ff5d-4e71-aaf7-2e167bbbb1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:27.805369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6efba7-ff5d-4e71-aaf7-2e167bbbb1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:27.806297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6efba7-ff5d-4e71-aaf7-2e167bbbb1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:27.808229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6efba7-ff5d-4e71-aaf7-2e167bbbb1b2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:27.818688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082dc34-ee52-49f8-b950-aed878a3d98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:27.837008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082dc34-ee52-49f8-b950-aed878a3d98b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:27.934096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 854/1731] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:27 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:27.935040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6efba7-ff5d-4e71-aaf7-2e167bbbb1b2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:27.960614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 878/1732] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:27 2022] POST /identity/v3/projects => generated 387 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:27.961817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082dc34-ee52-49f8-b950-aed878a3d98b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:28.201477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082dc34-ee52-49f8-b950-aed878a3d98b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:28.222226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6efba7-ff5d-4e71-aaf7-2e167bbbb1b2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:28.230467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cb48d-3765-454c-87fb-3d142a56692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:28.234929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cb48d-3765-454c-87fb-3d142a56692e admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:28.236118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cb48d-3765-454c-87fb-3d142a56692e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:28.236403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cb48d-3765-454c-87fb-3d142a56692e admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:28.238925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cb48d-3765-454c-87fb-3d142a56692e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:28.252556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cb48d-3765-454c-87fb-3d142a56692e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:28.253502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70abf55-5ca3-4e0a-a8b2-b312f657b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:28.254864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70abf55-5ca3-4e0a-a8b2-b312f657b767 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:28.255141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70abf55-5ca3-4e0a-a8b2-b312f657b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:28.261127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70abf55-5ca3-4e0a-a8b2-b312f657b767 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:28.261868 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70abf55-5ca3-4e0a-a8b2-b312f657b767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:28.272131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70abf55-5ca3-4e0a-a8b2-b312f657b767 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:28.458965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 879/1733] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:27 2022] POST /identity/v3/users => generated 300 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:28.458965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cb48d-3765-454c-87fb-3d142a56692e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:28.458965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-649cb48d-3765-454c-87fb-3d142a56692e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:28.471664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cb48d-3765-454c-87fb-3d142a56692e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:28.491571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:28.492644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:28.493043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:28.495104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] PATH_INFO: `/v3/users/42d7679a0ae046d7abec7c0dd0985fcf` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:28.500542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d7679a0ae046d7abec7c0dd0985fcf)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:28.502858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:28.528158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 855/1734] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:27 2022] POST /identity/v3/users => generated 291 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:28.528158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70abf55-5ca3-4e0a-a8b2-b312f657b767 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:28.562412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70abf55-5ca3-4e0a-a8b2-b312f657b767 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:28.583609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b011d1-267b-452f-abe2-6df5e1b2becf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:28.584436 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b011d1-267b-452f-abe2-6df5e1b2becf admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:28.584864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b011d1-267b-452f-abe2-6df5e1b2becf admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:28.585038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b011d1-267b-452f-abe2-6df5e1b2becf admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:28.585967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b011d1-267b-452f-abe2-6df5e1b2becf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:28.587480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b011d1-267b-452f-abe2-6df5e1b2becf admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:28.614444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 856/1735] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:28.618632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b011d1-267b-452f-abe2-6df5e1b2becf admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:28.656461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b011d1-267b-452f-abe2-6df5e1b2becf admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:28.666713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db3afe-0990-4ee1-b87c-325875eab895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:28.667563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db3afe-0990-4ee1-b87c-325875eab895 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:28.668171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db3afe-0990-4ee1-b87c-325875eab895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:28.673443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db3afe-0990-4ee1-b87c-325875eab895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:28.674395 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db3afe-0990-4ee1-b87c-325875eab895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:28.679743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db3afe-0990-4ee1-b87c-325875eab895 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:28.698272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 857/1736] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:28.699248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db3afe-0990-4ee1-b87c-325875eab895 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:28.712209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db3afe-0990-4ee1-b87c-325875eab895 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:28.717596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce24b49-e9f8-4b7a-8c4d-10011b9049f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:28.718978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce24b49-e9f8-4b7a-8c4d-10011b9049f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:28.719337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce24b49-e9f8-4b7a-8c4d-10011b9049f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:28.720620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce24b49-e9f8-4b7a-8c4d-10011b9049f4 admin admin] PATH_INFO: `/v3/projects/1fdf90fc794448dd995ba4b799ab6346/users/c82a181335834ba6916b6defa63125d9/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:28.740383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce24b49-e9f8-4b7a-8c4d-10011b9049f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdf90fc794448dd995ba4b799ab6346, user_id=c82a181335834ba6916b6defa63125d9, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:28.743418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce24b49-e9f8-4b7a-8c4d-10011b9049f4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:29.916336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 858/1737] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:28 2022] PUT /identity/v3/projects/1fdf90fc794448dd995ba4b799ab6346/users/c82a181335834ba6916b6defa63125d9/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 1207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:29.916336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce24b49-e9f8-4b7a-8c4d-10011b9049f4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:30.018079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d7679a0ae046d7abec7c0dd0985fcf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:30.020119 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d7679a0ae046d7abec7c0dd0985fcf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:30.036457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d7679a0ae046d7abec7c0dd0985fcf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:30.066336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d7679a0ae046d7abec7c0dd0985fcf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:30.094502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-547bb583-2ee6-4217-b7c4-5d8024d45a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d7679a0ae046d7abec7c0dd0985fcf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:30.104276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce24b49-e9f8-4b7a-8c4d-10011b9049f4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:30.133880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb7afa-f2c8-4d3d-a58e-cdedfc495b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:30.134988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb7afa-f2c8-4d3d-a58e-cdedfc495b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.136808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb7afa-f2c8-4d3d-a58e-cdedfc495b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.137324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb7afa-f2c8-4d3d-a58e-cdedfc495b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.138960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb7afa-f2c8-4d3d-a58e-cdedfc495b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:30.143845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb7afa-f2c8-4d3d-a58e-cdedfc495b7b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:30.186830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 880/1738] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:28 2022] DELETE /identity/v3/users/42d7679a0ae046d7abec7c0dd0985fcf => generated 0 bytes in 1769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:30.188954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321cf0d-48f7-48d2-98fa-634008260804 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.189407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321cf0d-48f7-48d2-98fa-634008260804 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.189834 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321cf0d-48f7-48d2-98fa-634008260804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.195900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 859/1739] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:30.206425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb7afa-f2c8-4d3d-a58e-cdedfc495b7b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:30.215292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-42eb7afa-f2c8-4d3d-a58e-cdedfc495b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:30.239394 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7321cf0d-48f7-48d2-98fa-634008260804 None None] MFA Rules not processed for user `aec8440b7bd84c2b9ce583a01adabf90`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:30.242365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7321cf0d-48f7-48d2-98fa-634008260804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:30.252884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb7afa-f2c8-4d3d-a58e-cdedfc495b7b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:30.478802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 881/1740] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:15:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:30.480446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8f0f-bd31-4810-980a-0589e49e3805 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.480740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8f0f-bd31-4810-980a-0589e49e3805 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.481016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb8f0f-bd31-4810-980a-0589e49e3805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.517409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4867b-e03b-4094-8375-d728be37ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:30.521487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4867b-e03b-4094-8375-d728be37ffb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.522718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4867b-e03b-4094-8375-d728be37ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.523017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4867b-e03b-4094-8375-d728be37ffb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.527627 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4867b-e03b-4094-8375-d728be37ffb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:30.541143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a0bb8f0f-bd31-4810-980a-0589e49e3805 None None] MFA Rules not processed for user `aec8440b7bd84c2b9ce583a01adabf90`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:30.541624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4867b-e03b-4094-8375-d728be37ffb7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:30.542682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a0bb8f0f-bd31-4810-980a-0589e49e3805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:30.561668 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 882/1741] 10.222.0.69 () {58 vars in 1015 bytes} [Mon May 16 15:15:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:30.571440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8213a-e2e7-49e2-8b0f-95d8ca2d70dc None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.575558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8213a-e2e7-49e2-8b0f-95d8ca2d70dc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.576547 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8213a-e2e7-49e2-8b0f-95d8ca2d70dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.606512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 860/1742] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:30.626800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4867b-e03b-4094-8375-d728be37ffb7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:30.629033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-61c8213a-e2e7-49e2-8b0f-95d8ca2d70dc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:30.631342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-61c8213a-e2e7-49e2-8b0f-95d8ca2d70dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:30.642024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c7b4867b-e03b-4094-8375-d728be37ffb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:30.665714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 883/1743] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:30.666773 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8213a-e2e7-49e2-8b0f-95d8ca2d70dc None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:30.668227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-61c8213a-e2e7-49e2-8b0f-95d8ca2d70dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:30.692433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4867b-e03b-4094-8375-d728be37ffb7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:30.724667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8213a-e2e7-49e2-8b0f-95d8ca2d70dc None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:30.724885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc742ed-d402-4ac1-b18f-320ff50ad7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:30.734468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84868cb0-b38c-4c92-8d94-c8dc70b8e9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:30.735318 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84868cb0-b38c-4c92-8d94-c8dc70b8e9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.735774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84868cb0-b38c-4c92-8d94-c8dc70b8e9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.736136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84868cb0-b38c-4c92-8d94-c8dc70b8e9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.740632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc742ed-d402-4ac1-b18f-320ff50ad7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.741109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc742ed-d402-4ac1-b18f-320ff50ad7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.741397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc742ed-d402-4ac1-b18f-320ff50ad7ba admin admin] PATH_INFO: `/v3/projects/ba887f8f2ecf4e809804d25f51f225c1/users/b584b90ac2af47cbb744e8b2be6fc8f2/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.762452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84868cb0-b38c-4c92-8d94-c8dc70b8e9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:30.762452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84868cb0-b38c-4c92-8d94-c8dc70b8e9b8 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:30.805523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 884/1744] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:30.806892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84868cb0-b38c-4c92-8d94-c8dc70b8e9b8 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:30.815978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc742ed-d402-4ac1-b18f-320ff50ad7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba887f8f2ecf4e809804d25f51f225c1, user_id=b584b90ac2af47cbb744e8b2be6fc8f2, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:30.818893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc742ed-d402-4ac1-b18f-320ff50ad7ba admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:30.831758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84868cb0-b38c-4c92-8d94-c8dc70b8e9b8 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:30.846777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713b9f9-b2c3-4d86-b5e1-5f0258d9a75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:30.847835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b9f9-b2c3-4d86-b5e1-5f0258d9a75d service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.848338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b9f9-b2c3-4d86-b5e1-5f0258d9a75d service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.849988 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b9f9-b2c3-4d86-b5e1-5f0258d9a75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.879560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713b9f9-b2c3-4d86-b5e1-5f0258d9a75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:30.888379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713b9f9-b2c3-4d86-b5e1-5f0258d9a75d service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:30.902695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 885/1745] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:30.903960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713b9f9-b2c3-4d86-b5e1-5f0258d9a75d service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:30.929816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713b9f9-b2c3-4d86-b5e1-5f0258d9a75d service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:30.943643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e1815-3c09-459f-8c63-1d4999542eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:30.946115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e1815-3c09-459f-8c63-1d4999542eae admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:30.946115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e1815-3c09-459f-8c63-1d4999542eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:30.946115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e1815-3c09-459f-8c63-1d4999542eae admin admin] PATH_INFO: `/v3/projects/1fdf90fc794448dd995ba4b799ab6346/users/c82a181335834ba6916b6defa63125d9/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:30.949525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 861/1746] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:30 2022] PUT /identity/v3/projects/ba887f8f2ecf4e809804d25f51f225c1/users/b584b90ac2af47cbb744e8b2be6fc8f2/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:30.951516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc742ed-d402-4ac1-b18f-320ff50ad7ba admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:30.960893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e1815-3c09-459f-8c63-1d4999542eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdf90fc794448dd995ba4b799ab6346, user_id=c82a181335834ba6916b6defa63125d9, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:30.963852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e1815-3c09-459f-8c63-1d4999542eae admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:31.008339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 886/1747] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:30 2022] PUT /identity/v3/projects/1fdf90fc794448dd995ba4b799ab6346/users/c82a181335834ba6916b6defa63125d9/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:31.024322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63849-bf7a-4e3f-8a95-2451b78bfe5b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:31.024994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63849-bf7a-4e3f-8a95-2451b78bfe5b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:31.024994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63849-bf7a-4e3f-8a95-2451b78bfe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:31.134186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a2f63849-bf7a-4e3f-8a95-2451b78bfe5b None None] MFA Rules not processed for user `b584b90ac2af47cbb744e8b2be6fc8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:31.135717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a2f63849-bf7a-4e3f-8a95-2451b78bfe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:31.168118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc742ed-d402-4ac1-b18f-320ff50ad7ba admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:31.283739 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c0dd-3ee1-46e5-b24f-e313a4b638b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:31.284407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c0dd-3ee1-46e5-b24f-e313a4b638b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:31.284689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c0dd-3ee1-46e5-b24f-e313a4b638b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:31.284959 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c0dd-3ee1-46e5-b24f-e313a4b638b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:31.310814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 887/1748] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:31.312446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c6875-4299-4066-ae9e-de81f8d72ddc None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:31.312887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c6875-4299-4066-ae9e-de81f8d72ddc None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:31.313940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c6875-4299-4066-ae9e-de81f8d72ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:31.365225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e98c6875-4299-4066-ae9e-de81f8d72ddc None None] MFA Rules not processed for user `c82a181335834ba6916b6defa63125d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:31.370819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e98c6875-4299-4066-ae9e-de81f8d72ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:31.381621 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c0dd-3ee1-46e5-b24f-e313a4b638b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:31.383515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c0dd-3ee1-46e5-b24f-e313a4b638b4 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:31.412330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 862/1749] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:31.414838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c0dd-3ee1-46e5-b24f-e313a4b638b4 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:31.441471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c0dd-3ee1-46e5-b24f-e313a4b638b4 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:31.453081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ede3a6-93d6-4972-bf21-c7e233f52242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:31.454104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ede3a6-93d6-4972-bf21-c7e233f52242 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:31.454422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ede3a6-93d6-4972-bf21-c7e233f52242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:31.454743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ede3a6-93d6-4972-bf21-c7e233f52242 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:31.456253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ede3a6-93d6-4972-bf21-c7e233f52242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:31.458255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ede3a6-93d6-4972-bf21-c7e233f52242 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:31.571403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 888/1750] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:31.572674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c6875-4299-4066-ae9e-de81f8d72ddc None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:31.574382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 863/1751] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:31 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:31.578198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ede3a6-93d6-4972-bf21-c7e233f52242 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:31.579419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e98c6875-4299-4066-ae9e-de81f8d72ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:31.813911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ede3a6-93d6-4972-bf21-c7e233f52242 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:31.817821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c6875-4299-4066-ae9e-de81f8d72ddc None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:31.829130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef266beb-5712-437a-ac29-f85a220fbe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:31.829869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef266beb-5712-437a-ac29-f85a220fbe03 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:31.830185 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef266beb-5712-437a-ac29-f85a220fbe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:31.830461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef266beb-5712-437a-ac29-f85a220fbe03 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:31.831475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef266beb-5712-437a-ac29-f85a220fbe03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:31.836327 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef266beb-5712-437a-ac29-f85a220fbe03 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:31.937090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326e83f-1af0-413c-809c-7184d8aaa1bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:31.946566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e83f-1af0-413c-809c-7184d8aaa1bb service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:31.947117 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e83f-1af0-413c-809c-7184d8aaa1bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:31.947951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e83f-1af0-413c-809c-7184d8aaa1bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:31.962695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 864/1752] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:31 2022] POST /identity/v3/users => generated 297 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:31.964070 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91d22-86db-4333-ab1f-db93809cac30 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:31.964573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91d22-86db-4333-ab1f-db93809cac30 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:31.964874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e91d22-86db-4333-ab1f-db93809cac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:32.024531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e7e91d22-86db-4333-ab1f-db93809cac30 None None] MFA Rules not processed for user `44ffd5660baa40a7a3d6918cb5d31e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:32.027676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e7e91d22-86db-4333-ab1f-db93809cac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:32.122070 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326e83f-1af0-413c-809c-7184d8aaa1bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:32.123550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326e83f-1af0-413c-809c-7184d8aaa1bb service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:32.165774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 889/1753] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:32.166701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326e83f-1af0-413c-809c-7184d8aaa1bb service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:32.199245 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326e83f-1af0-413c-809c-7184d8aaa1bb service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:32.210937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92512f6-c730-47ab-adf0-05d2cc47237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:32.211613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92512f6-c730-47ab-adf0-05d2cc47237f admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:32.211901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92512f6-c730-47ab-adf0-05d2cc47237f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:32.212177 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92512f6-c730-47ab-adf0-05d2cc47237f admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:32.212918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92512f6-c730-47ab-adf0-05d2cc47237f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:32.214563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92512f6-c730-47ab-adf0-05d2cc47237f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:32.241156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 890/1754] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:32.242109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92512f6-c730-47ab-adf0-05d2cc47237f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:32.268018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 865/1755] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:32.271317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92512f6-c730-47ab-adf0-05d2cc47237f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:32.282320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad302dc5-815a-4da4-97ea-43bf61805363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:32.283371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad302dc5-815a-4da4-97ea-43bf61805363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:32.283524 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad302dc5-815a-4da4-97ea-43bf61805363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:32.283869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad302dc5-815a-4da4-97ea-43bf61805363 admin admin] PATH_INFO: `/v3/projects/93199bb3b5a549de816acef54c3600aa/users/d813afba221a4b8dad81c57d9e364194/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:32.329572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad302dc5-815a-4da4-97ea-43bf61805363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93199bb3b5a549de816acef54c3600aa, user_id=d813afba221a4b8dad81c57d9e364194, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:32.332244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad302dc5-815a-4da4-97ea-43bf61805363 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:32.467716 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 891/1756] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:32 2022] PUT /identity/v3/projects/93199bb3b5a549de816acef54c3600aa/users/d813afba221a4b8dad81c57d9e364194/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:32.472882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91d22-86db-4333-ab1f-db93809cac30 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:32.485723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e91d22-86db-4333-ab1f-db93809cac30 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:33.195223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a3e14-7581-41b6-a564-d5cdca67da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:33.195888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a3e14-7581-41b6-a564-d5cdca67da75 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:33.195888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a3e14-7581-41b6-a564-d5cdca67da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:33.197063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a3e14-7581-41b6-a564-d5cdca67da75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:33.197063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a3e14-7581-41b6-a564-d5cdca67da75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:33.201119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a3e14-7581-41b6-a564-d5cdca67da75 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:33.225997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 866/1757] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 754 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:33.226512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad302dc5-815a-4da4-97ea-43bf61805363 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:33.250837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad302dc5-815a-4da4-97ea-43bf61805363 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:33.262186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9768a-5b3f-4881-9e40-d743b47801ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:33.264670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9768a-5b3f-4881-9e40-d743b47801ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:33.271496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9768a-5b3f-4881-9e40-d743b47801ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:33.271496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9768a-5b3f-4881-9e40-d743b47801ee admin admin] PATH_INFO: `/v3/projects/93199bb3b5a549de816acef54c3600aa/users/d813afba221a4b8dad81c57d9e364194/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:33.271496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9768a-5b3f-4881-9e40-d743b47801ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=93199bb3b5a549de816acef54c3600aa, user_id=d813afba221a4b8dad81c57d9e364194, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:33.274667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9768a-5b3f-4881-9e40-d743b47801ee admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:33.291176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 892/1758] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:33 2022] PUT /identity/v3/projects/93199bb3b5a549de816acef54c3600aa/users/d813afba221a4b8dad81c57d9e364194/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:33.307532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88827c0e-665a-47a4-b9fe-3c341b85dd2c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:33.308175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88827c0e-665a-47a4-b9fe-3c341b85dd2c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:33.309546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88827c0e-665a-47a4-b9fe-3c341b85dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:33.427173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-88827c0e-665a-47a4-b9fe-3c341b85dd2c None None] MFA Rules not processed for user `d813afba221a4b8dad81c57d9e364194`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:33.427173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-88827c0e-665a-47a4-b9fe-3c341b85dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:33.599018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 867/1759] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:33.706965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9768a-5b3f-4881-9e40-d743b47801ee admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:33.708870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-37f9768a-5b3f-4881-9e40-d743b47801ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:33.941961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9768a-5b3f-4881-9e40-d743b47801ee admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:33.948900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746215a-ac96-4fa8-9f73-86bd740c5b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:33.952240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746215a-ac96-4fa8-9f73-86bd740c5b7c service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:33.952788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746215a-ac96-4fa8-9f73-86bd740c5b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:33.954228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746215a-ac96-4fa8-9f73-86bd740c5b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:33.987706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746215a-ac96-4fa8-9f73-86bd740c5b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:33.992201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746215a-ac96-4fa8-9f73-86bd740c5b7c service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:34.061388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 893/1760] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:34.544688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88827c0e-665a-47a4-b9fe-3c341b85dd2c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:34.561164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88827c0e-665a-47a4-b9fe-3c341b85dd2c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:34.569483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfb87c-d9b1-4a82-bbd2-3cbde4768155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:34.570913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfb87c-d9b1-4a82-bbd2-3cbde4768155 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:34.571170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfb87c-d9b1-4a82-bbd2-3cbde4768155 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:34.571519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfb87c-d9b1-4a82-bbd2-3cbde4768155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:34.623368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d9ce6-ced2-4055-bdd3-389295f2f2d0 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:34.624544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d9ce6-ced2-4055-bdd3-389295f2f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:34.625021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d9ce6-ced2-4055-bdd3-389295f2f2d0 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:34.631469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 894/1761] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:15:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:34.650463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d9ce6-ced2-4055-bdd3-389295f2f2d0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:34.675705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d9ce6-ced2-4055-bdd3-389295f2f2d0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:34.692582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:34.692703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:34.692914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfb87c-d9b1-4a82-bbd2-3cbde4768155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:34.693024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:34.693264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:34.695001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfb87c-d9b1-4a82-bbd2-3cbde4768155 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:34.695196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:34.712032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 868/1762] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:34.713393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df849a3-2cfb-402f-b1a2-8e6e0434564d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:34.713866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df849a3-2cfb-402f-b1a2-8e6e0434564d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:34.713982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df849a3-2cfb-402f-b1a2-8e6e0434564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:34.735979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7df849a3-2cfb-402f-b1a2-8e6e0434564d None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:34.737043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7df849a3-2cfb-402f-b1a2-8e6e0434564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:34.868334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 869/1763] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:15:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:34.869719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df849a3-2cfb-402f-b1a2-8e6e0434564d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:34.871379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7df849a3-2cfb-402f-b1a2-8e6e0434564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:34.880925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:34.882863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:34.903735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 895/1764] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:34.937420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:34.939115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:34.965794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d11e86-6d2a-4d84-887a-b8f6f08da915 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:34.992938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77d897-304b-4439-aeb8-cb4d642c493c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:34.994868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77d897-304b-4439-aeb8-cb4d642c493c service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:34.995336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77d897-304b-4439-aeb8-cb4d642c493c service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:34.995950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77d897-304b-4439-aeb8-cb4d642c493c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:34.997936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df849a3-2cfb-402f-b1a2-8e6e0434564d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:35.003703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:35.004583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:35.004860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:35.005130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] PATH_INFO: `/v3/projects/d9e6651102514605a4f2e00efbdfe387` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:35.006649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e6651102514605a4f2e00efbdfe387)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:35.013611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:35.021395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77d897-304b-4439-aeb8-cb4d642c493c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:35.023255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77d897-304b-4439-aeb8-cb4d642c493c service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:35.042180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 896/1765] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:35.192518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e6651102514605a4f2e00efbdfe387', 'request_id': 'req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.199746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e6651102514605a4f2e00efbdfe387', 'request_id': 'req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.206239 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e6651102514605a4f2e00efbdfe387', 'request_id': 'req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.282650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] The token cache is being invalidate because project d9e6651102514605a4f2e00efbdfe387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:35.287078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.287078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.287078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 870/1766] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:34 2022] DELETE /identity/v3/projects/d9e6651102514605a4f2e00efbdfe387 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:35.289067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77d897-304b-4439-aeb8-cb4d642c493c service nova] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:35.299557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77d897-304b-4439-aeb8-cb4d642c493c service nova] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:35.360230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:35.361644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:35.361989 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:35.362382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] PATH_INFO: `/v3/users/0a6b07b803aa4da9873ff56becb6f878` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:35.364014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6b07b803aa4da9873ff56becb6f878)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:35.367254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:35.606129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6b07b803aa4da9873ff56becb6f878'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.607041 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6b07b803aa4da9873ff56becb6f878'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.608502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6b07b803aa4da9873ff56becb6f878'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.645112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6b07b803aa4da9873ff56becb6f878'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.655192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f6d0a7a5-7637-46c6-9dce-1424309eebcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6b07b803aa4da9873ff56becb6f878'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:35.744553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:35.746323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:35.757475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 897/1767] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:35 2022] DELETE /identity/v3/users/0a6b07b803aa4da9873ff56becb6f878 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:35.774391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ea1f2-9873-4511-9c6d-87fce0eaa6d4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:35.918966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:35.919982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:35.920266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:35.920581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] PATH_INFO: `/v3/users/b584b90ac2af47cbb744e8b2be6fc8f2` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:35.927581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b584b90ac2af47cbb744e8b2be6fc8f2)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:35.929544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:36.192399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b584b90ac2af47cbb744e8b2be6fc8f2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.193046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b584b90ac2af47cbb744e8b2be6fc8f2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.205279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b584b90ac2af47cbb744e8b2be6fc8f2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.206031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b584b90ac2af47cbb744e8b2be6fc8f2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.212768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6cc06a66-4324-41d8-b77e-753d20c8aec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b584b90ac2af47cbb744e8b2be6fc8f2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.270854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ffec6-27ef-47d3-b928-549261fbcdae None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:36.271144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ffec6-27ef-47d3-b928-549261fbcdae None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:36.271417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ffec6-27ef-47d3-b928-549261fbcdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:36.289492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9e6ffec6-27ef-47d3-b928-549261fbcdae None None] MFA Rules not processed for user `911ef817a1ee4790ad97e857a299fb01`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:36.291120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9e6ffec6-27ef-47d3-b928-549261fbcdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:36.334635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 871/1768] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:35 2022] DELETE /identity/v3/users/b584b90ac2af47cbb744e8b2be6fc8f2 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:36.341659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce10a1-2e65-4fa6-9b53-d0b13e0e571f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:36.341659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce10a1-2e65-4fa6-9b53-d0b13e0e571f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:36.341659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce10a1-2e65-4fa6-9b53-d0b13e0e571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:36.366230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c3ce10a1-2e65-4fa6-9b53-d0b13e0e571f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:36.367483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c3ce10a1-2e65-4fa6-9b53-d0b13e0e571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:36.369030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 898/1769] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:36.427082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 872/1770] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:36.437000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ffec6-27ef-47d3-b928-549261fbcdae None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:36.438944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9e6ffec6-27ef-47d3-b928-549261fbcdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:36.452322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce10a1-2e65-4fa6-9b53-d0b13e0e571f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:36.454713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c3ce10a1-2e65-4fa6-9b53-d0b13e0e571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:36.466740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce10a1-2e65-4fa6-9b53-d0b13e0e571f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:36.471501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:36.472359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:36.472699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:36.472897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] PATH_INFO: `/v3/projects/e90c465d2fe64f97951e0a66ef5038a1` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:36.474098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90c465d2fe64f97951e0a66ef5038a1)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:36.476143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:36.504309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ffec6-27ef-47d3-b928-549261fbcdae None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:36.565835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adcee4-58cf-4a20-85ee-675db1c694d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:36.566528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcee4-58cf-4a20-85ee-675db1c694d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:36.566812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcee4-58cf-4a20-85ee-675db1c694d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:36.567129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcee4-58cf-4a20-85ee-675db1c694d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:36.581803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adcee4-58cf-4a20-85ee-675db1c694d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:36.583362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adcee4-58cf-4a20-85ee-675db1c694d1 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:36.605377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 899/1771] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:36.622688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90c465d2fe64f97951e0a66ef5038a1', 'request_id': 'req-20ebb03d-0332-4493-be0b-50163669276b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.629994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90c465d2fe64f97951e0a66ef5038a1', 'request_id': 'req-20ebb03d-0332-4493-be0b-50163669276b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.637591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90c465d2fe64f97951e0a66ef5038a1', 'request_id': 'req-20ebb03d-0332-4493-be0b-50163669276b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.723016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] The token cache is being invalidate because project e90c465d2fe64f97951e0a66ef5038a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:36.723309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.723992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-20ebb03d-0332-4493-be0b-50163669276b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:36.729180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 873/1772] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:36 2022] DELETE /identity/v3/projects/e90c465d2fe64f97951e0a66ef5038a1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:36.732030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d17b-a07d-43a0-8a09-3f9d117a8c53 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:36.732522 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d17b-a07d-43a0-8a09-3f9d117a8c53 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:36.732615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d17b-a07d-43a0-8a09-3f9d117a8c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:36.754209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-fef7d17b-a07d-43a0-8a09-3f9d117a8c53 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:36.755579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fef7d17b-a07d-43a0-8a09-3f9d117a8c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:36.872794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 900/1773] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:36.881569 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a637f-095f-4cec-a6e7-17b7183c933e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:36.882016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a637f-095f-4cec-a6e7-17b7183c933e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:36.882127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a637f-095f-4cec-a6e7-17b7183c933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:36.917613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-922a637f-095f-4cec-a6e7-17b7183c933e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:36.919139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-922a637f-095f-4cec-a6e7-17b7183c933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:36.941683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 874/1774] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:36.946895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7d17b-a07d-43a0-8a09-3f9d117a8c53 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:36.960571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7d17b-a07d-43a0-8a09-3f9d117a8c53 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:36.966125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15e3e2-cc70-480a-9d79-238a8d66a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:36.967349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15e3e2-cc70-480a-9d79-238a8d66a238 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:36.968004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15e3e2-cc70-480a-9d79-238a8d66a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:36.968521 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15e3e2-cc70-480a-9d79-238a8d66a238 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:36.970270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15e3e2-cc70-480a-9d79-238a8d66a238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:36.970808 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15e3e2-cc70-480a-9d79-238a8d66a238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:36.973441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15e3e2-cc70-480a-9d79-238a8d66a238 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:36.996447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 901/1775] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:15:37.001469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a637f-095f-4cec-a6e7-17b7183c933e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:37.018427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a637f-095f-4cec-a6e7-17b7183c933e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:37.032485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e76b8-c630-4015-b5c5-3d1713730ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:37.033180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e76b8-c630-4015-b5c5-3d1713730ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:37.033449 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e76b8-c630-4015-b5c5-3d1713730ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:37.034274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e76b8-c630-4015-b5c5-3d1713730ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:37.034982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e76b8-c630-4015-b5c5-3d1713730ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:37.040723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e76b8-c630-4015-b5c5-3d1713730ceb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:37.137747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 875/1776] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:36 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:37.142797 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15e3e2-cc70-480a-9d79-238a8d66a238 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:37.153636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15e3e2-cc70-480a-9d79-238a8d66a238 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:37.228709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6684c-5b72-465a-a24f-1af104067bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:37.229689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6684c-5b72-465a-a24f-1af104067bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:37.230043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6684c-5b72-465a-a24f-1af104067bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:37.230424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6684c-5b72-465a-a24f-1af104067bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:37.231191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6684c-5b72-465a-a24f-1af104067bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:37.233576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6684c-5b72-465a-a24f-1af104067bf1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:37.368805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 902/1777] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:37 2022] POST /identity/v3/users => generated 282 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:37.369608 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e76b8-c630-4015-b5c5-3d1713730ceb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:37.386736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e76b8-c630-4015-b5c5-3d1713730ceb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:37.406902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd02ce-46f8-4ca6-b20f-dce6649bd135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:37.409776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd02ce-46f8-4ca6-b20f-dce6649bd135 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:37.410767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd02ce-46f8-4ca6-b20f-dce6649bd135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:37.411806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd02ce-46f8-4ca6-b20f-dce6649bd135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:37.413594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd02ce-46f8-4ca6-b20f-dce6649bd135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:37.425793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd02ce-46f8-4ca6-b20f-dce6649bd135 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:37.482500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 876/1778] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:37.483788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6684c-5b72-465a-a24f-1af104067bf1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:37.501120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6684c-5b72-465a-a24f-1af104067bf1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:37.523072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7dd8b-aa0f-46a4-b688-9696306edf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:37.524974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7dd8b-aa0f-46a4-b688-9696306edf00 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:37.525531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7dd8b-aa0f-46a4-b688-9696306edf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:37.526337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7dd8b-aa0f-46a4-b688-9696306edf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:37.528429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7dd8b-aa0f-46a4-b688-9696306edf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:37.534696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7dd8b-aa0f-46a4-b688-9696306edf00 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:37.563099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 903/1779] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:37.573253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd02ce-46f8-4ca6-b20f-dce6649bd135 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:37.583960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd02ce-46f8-4ca6-b20f-dce6649bd135 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:37.595733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f5450-924d-4ee9-b301-f0641e8969ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:37.601708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5450-924d-4ee9-b301-f0641e8969ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:37.601708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5450-924d-4ee9-b301-f0641e8969ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:37.601708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5450-924d-4ee9-b301-f0641e8969ee admin admin] PATH_INFO: `/v3/projects/1388742216b24f518f39f59d78d63deb/users/94543c3e1f774eb48daddbce100dcc08/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:37.615414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f5450-924d-4ee9-b301-f0641e8969ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1388742216b24f518f39f59d78d63deb, user_id=94543c3e1f774eb48daddbce100dcc08, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:37.618328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f5450-924d-4ee9-b301-f0641e8969ee admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:37.737822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 877/1780] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:37 2022] PUT /identity/v3/projects/1388742216b24f518f39f59d78d63deb/users/94543c3e1f774eb48daddbce100dcc08/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:37.765572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03510e-db66-4a7c-817a-a7b9b3465868 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:37.766147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03510e-db66-4a7c-817a-a7b9b3465868 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:37.766239 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03510e-db66-4a7c-817a-a7b9b3465868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:37.808590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9f03510e-db66-4a7c-817a-a7b9b3465868 None None] MFA Rules not processed for user `94543c3e1f774eb48daddbce100dcc08`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:37.809869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9f03510e-db66-4a7c-817a-a7b9b3465868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:37.924756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 904/1781] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:37.929070 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f5450-924d-4ee9-b301-f0641e8969ee admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:38.014501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f5450-924d-4ee9-b301-f0641e8969ee admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:38.020147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d17c-34fb-48ff-bc13-9e89245b8278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:38.020908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d17c-34fb-48ff-bc13-9e89245b8278 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:38.021244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d17c-34fb-48ff-bc13-9e89245b8278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:38.021679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d17c-34fb-48ff-bc13-9e89245b8278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:38.024038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402d17c-34fb-48ff-bc13-9e89245b8278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:38.028086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402d17c-34fb-48ff-bc13-9e89245b8278 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:38.103432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03510e-db66-4a7c-817a-a7b9b3465868 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:38.105390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9f03510e-db66-4a7c-817a-a7b9b3465868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:38.136241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03510e-db66-4a7c-817a-a7b9b3465868 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:38.158489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:38.158489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:38.158489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:38.158489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] PATH_INFO: `/v3/projects/ba887f8f2ecf4e809804d25f51f225c1` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:38.159854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba887f8f2ecf4e809804d25f51f225c1)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:38.162315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:38.216337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 878/1782] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:37 2022] POST /identity/v3/projects => generated 365 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:38.221532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d17c-34fb-48ff-bc13-9e89245b8278 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:38.343473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d17c-34fb-48ff-bc13-9e89245b8278 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:38.360881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba887f8f2ecf4e809804d25f51f225c1', 'request_id': 'req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:38.484021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba887f8f2ecf4e809804d25f51f225c1', 'request_id': 'req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:38.492047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba887f8f2ecf4e809804d25f51f225c1', 'request_id': 'req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:38.542671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8f10e-4f00-4bbd-97f7-0964c16d5502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:38.551676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8f10e-4f00-4bbd-97f7-0964c16d5502 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:38.558800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8f10e-4f00-4bbd-97f7-0964c16d5502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:38.559363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8f10e-4f00-4bbd-97f7-0964c16d5502 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:38.561535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8f10e-4f00-4bbd-97f7-0964c16d5502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:38.568243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8f10e-4f00-4bbd-97f7-0964c16d5502 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:38.575044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] The token cache is being invalidate because project ba887f8f2ecf4e809804d25f51f225c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:38.581809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:38.586607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:38.590866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 905/1783] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:38 2022] DELETE /identity/v3/projects/ba887f8f2ecf4e809804d25f51f225c1 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:38.595706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:38.601869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:38.661700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f3d45-d51f-4d2b-bd67-e0bec7580d72 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:38.677690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:38.678674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:38.681771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:38.681771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] PATH_INFO: `/v3/users/d813afba221a4b8dad81c57d9e364194` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:38.681771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d813afba221a4b8dad81c57d9e364194)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:38.684027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 879/1784] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:38 2022] POST /identity/v3/users => generated 289 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:38.685039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8f10e-4f00-4bbd-97f7-0964c16d5502 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:38.686989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1ff8f10e-4f00-4bbd-97f7-0964c16d5502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:38.694455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:38.702109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8f10e-4f00-4bbd-97f7-0964c16d5502 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:38.710099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0382bbf-5a39-4040-8390-d6282cf24a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:38.710099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0382bbf-5a39-4040-8390-d6282cf24a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:38.710099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0382bbf-5a39-4040-8390-d6282cf24a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:38.710099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0382bbf-5a39-4040-8390-d6282cf24a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:38.710913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0382bbf-5a39-4040-8390-d6282cf24a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:38.711892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0382bbf-5a39-4040-8390-d6282cf24a48 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:38.735810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 880/1785] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:38.738864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0382bbf-5a39-4040-8390-d6282cf24a48 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:38.780286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0382bbf-5a39-4040-8390-d6282cf24a48 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:38.803674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28100c72-e26b-4bfb-9004-9461b1462214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:38.804987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28100c72-e26b-4bfb-9004-9461b1462214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:38.805468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28100c72-e26b-4bfb-9004-9461b1462214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:38.806116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28100c72-e26b-4bfb-9004-9461b1462214 admin admin] PATH_INFO: `/v3/projects/b75b0ce1a551469bbead327073a360b7/users/b9e10290bccf4c2da32d5e2e1e88764e/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:38.835795 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28100c72-e26b-4bfb-9004-9461b1462214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75b0ce1a551469bbead327073a360b7, user_id=b9e10290bccf4c2da32d5e2e1e88764e, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:38.840327 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28100c72-e26b-4bfb-9004-9461b1462214 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:38.923001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd813afba221a4b8dad81c57d9e364194'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:38.924027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd813afba221a4b8dad81c57d9e364194'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:38.924833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd813afba221a4b8dad81c57d9e364194'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:38.939920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd813afba221a4b8dad81c57d9e364194'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:38.960756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 881/1786] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:38 2022] PUT /identity/v3/projects/b75b0ce1a551469bbead327073a360b7/users/b9e10290bccf4c2da32d5e2e1e88764e/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:38.971521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28100c72-e26b-4bfb-9004-9461b1462214 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:38.978148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-28100c72-e26b-4bfb-9004-9461b1462214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:38.994088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd813afba221a4b8dad81c57d9e364194'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:39.107185 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28100c72-e26b-4bfb-9004-9461b1462214 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:39.115443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab383ac-45c4-4c7e-8d53-e42c32639b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:39.116220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab383ac-45c4-4c7e-8d53-e42c32639b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:39.116812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab383ac-45c4-4c7e-8d53-e42c32639b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:39.116925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab383ac-45c4-4c7e-8d53-e42c32639b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:39.117716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab383ac-45c4-4c7e-8d53-e42c32639b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:39.119455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab383ac-45c4-4c7e-8d53-e42c32639b57 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:39.119732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 906/1787] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:38 2022] DELETE /identity/v3/users/d813afba221a4b8dad81c57d9e364194 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:39.142506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 882/1788] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:39.146155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:39.303270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7799a-0643-4311-8e3a-bbe2bd1a209b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:39.313906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a7201-8c3f-421a-8808-443b8a92bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:39.315339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a7201-8c3f-421a-8808-443b8a92bc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:39.319534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a7201-8c3f-421a-8808-443b8a92bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:39.320021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a7201-8c3f-421a-8808-443b8a92bc46 admin admin] PATH_INFO: `/v3/projects/b75b0ce1a551469bbead327073a360b7/users/b9e10290bccf4c2da32d5e2e1e88764e/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:39.324068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a7201-8c3f-421a-8808-443b8a92bc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75b0ce1a551469bbead327073a360b7, user_id=b9e10290bccf4c2da32d5e2e1e88764e, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:39.330116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a7201-8c3f-421a-8808-443b8a92bc46 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:39.368928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 907/1789] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:39 2022] PUT /identity/v3/projects/b75b0ce1a551469bbead327073a360b7/users/b9e10290bccf4c2da32d5e2e1e88764e/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:39.372757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3914eb-fcbe-4691-b766-212a78677e2a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:39.373295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3914eb-fcbe-4691-b766-212a78677e2a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:39.373877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3914eb-fcbe-4691-b766-212a78677e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:39.445480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9f3914eb-fcbe-4691-b766-212a78677e2a None None] MFA Rules not processed for user `b9e10290bccf4c2da32d5e2e1e88764e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:39.447110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9f3914eb-fcbe-4691-b766-212a78677e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:39.611159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 883/1790] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:39.627971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a7201-8c3f-421a-8808-443b8a92bc46 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:39.630512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-584a7201-8c3f-421a-8808-443b8a92bc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:39.786429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a7201-8c3f-421a-8808-443b8a92bc46 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:39.807152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10824b0f-41c4-40f9-9dde-2a22d3758021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:39.809420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10824b0f-41c4-40f9-9dde-2a22d3758021 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:39.812065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10824b0f-41c4-40f9-9dde-2a22d3758021 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:39.813616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10824b0f-41c4-40f9-9dde-2a22d3758021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:39.847648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10824b0f-41c4-40f9-9dde-2a22d3758021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:39.849988 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10824b0f-41c4-40f9-9dde-2a22d3758021 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:39.875623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 908/1791] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:40.445578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3914eb-fcbe-4691-b766-212a78677e2a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:40.462124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3914eb-fcbe-4691-b766-212a78677e2a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:40.469141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f9943-32da-4a9b-b44b-3bf96cbad944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:40.471617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f9943-32da-4a9b-b44b-3bf96cbad944 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:40.472420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f9943-32da-4a9b-b44b-3bf96cbad944 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:40.472869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f9943-32da-4a9b-b44b-3bf96cbad944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:40.476800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e53f9943-32da-4a9b-b44b-3bf96cbad944 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:40.668918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f9943-32da-4a9b-b44b-3bf96cbad944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:40.670573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f9943-32da-4a9b-b44b-3bf96cbad944 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:40.687664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 884/1792] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:40.960490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10824b0f-41c4-40f9-9dde-2a22d3758021 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:40.962898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-10824b0f-41c4-40f9-9dde-2a22d3758021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:41.182614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10824b0f-41c4-40f9-9dde-2a22d3758021 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:41.201089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:41.203349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:41.203984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:41.204455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] PATH_INFO: `/v3/projects/93199bb3b5a549de816acef54c3600aa` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:41.206471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93199bb3b5a549de816acef54c3600aa)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:41.209776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:41.388520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93199bb3b5a549de816acef54c3600aa', 'request_id': 'req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:41.473307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93199bb3b5a549de816acef54c3600aa', 'request_id': 'req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:41.485220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93199bb3b5a549de816acef54c3600aa', 'request_id': 'req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:41.517861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] The token cache is being invalidate because project 93199bb3b5a549de816acef54c3600aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:41.521328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:41.522356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e71bf8ca-fe4d-4a28-9d60-715a4fdef337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:41.524287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 909/1793] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:40 2022] DELETE /identity/v3/projects/93199bb3b5a549de816acef54c3600aa => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:41.529201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef663d-79b6-4491-941f-6f15e21a7111 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:41.529712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef663d-79b6-4491-941f-6f15e21a7111 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:41.529939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef663d-79b6-4491-941f-6f15e21a7111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:41.559898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e4ef663d-79b6-4491-941f-6f15e21a7111 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:41.561381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e4ef663d-79b6-4491-941f-6f15e21a7111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:41.726546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 885/1794] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:41.742648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade895f-71b9-40e4-9ddc-a0a580db2fb1 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:41.743625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade895f-71b9-40e4-9ddc-a0a580db2fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:41.743625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade895f-71b9-40e4-9ddc-a0a580db2fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:41.777283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8ade895f-71b9-40e4-9ddc-a0a580db2fb1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:41.779576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8ade895f-71b9-40e4-9ddc-a0a580db2fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:41.789895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 910/1795] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:41.794487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef663d-79b6-4491-941f-6f15e21a7111 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:41.808315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef663d-79b6-4491-941f-6f15e21a7111 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:41.816649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21edd43-813e-4808-9bd6-b320e9cb4fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:41.817644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21edd43-813e-4808-9bd6-b320e9cb4fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:41.818242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21edd43-813e-4808-9bd6-b320e9cb4fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:41.818694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21edd43-813e-4808-9bd6-b320e9cb4fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:41.820111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21edd43-813e-4808-9bd6-b320e9cb4fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:41.820647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21edd43-813e-4808-9bd6-b320e9cb4fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:41.823251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21edd43-813e-4808-9bd6-b320e9cb4fa1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:41.850925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 886/1796] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:15:41.855066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade895f-71b9-40e4-9ddc-a0a580db2fb1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:41.866441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade895f-71b9-40e4-9ddc-a0a580db2fb1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:41.872250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb508-750b-42ce-851c-c78827e95673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:41.873213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb508-750b-42ce-851c-c78827e95673 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:41.874583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb508-750b-42ce-851c-c78827e95673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:41.875384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdb508-750b-42ce-851c-c78827e95673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:41.876540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdb508-750b-42ce-851c-c78827e95673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:41.878775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdb508-750b-42ce-851c-c78827e95673 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:42.061472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 911/1797] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:41 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:42.063184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21edd43-813e-4808-9bd6-b320e9cb4fa1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:42.077439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21edd43-813e-4808-9bd6-b320e9cb4fa1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:42.236246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea28260-d91f-4c17-93b0-328a5909c03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:42.238936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea28260-d91f-4c17-93b0-328a5909c03e admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:42.239316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea28260-d91f-4c17-93b0-328a5909c03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:42.242418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea28260-d91f-4c17-93b0-328a5909c03e admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:42.242418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea28260-d91f-4c17-93b0-328a5909c03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:42.247848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea28260-d91f-4c17-93b0-328a5909c03e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:42.469767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 887/1798] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:42 2022] POST /identity/v3/users => generated 286 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:15:42.472319 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb508-750b-42ce-851c-c78827e95673 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:42.505557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdb508-750b-42ce-851c-c78827e95673 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:42.520788 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277358a9-8b15-4409-904e-c3d463dbf49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:42.521623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277358a9-8b15-4409-904e-c3d463dbf49c admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:42.522016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277358a9-8b15-4409-904e-c3d463dbf49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:42.522744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277358a9-8b15-4409-904e-c3d463dbf49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:42.523599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277358a9-8b15-4409-904e-c3d463dbf49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:42.525347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277358a9-8b15-4409-904e-c3d463dbf49c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:42.566878 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea28260-d91f-4c17-93b0-328a5909c03e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:42.581902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 912/1799] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:42.582443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea28260-d91f-4c17-93b0-328a5909c03e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:42.596610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60758879-3108-428b-9be1-2d8a5af67388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:42.597580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60758879-3108-428b-9be1-2d8a5af67388 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:42.598038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60758879-3108-428b-9be1-2d8a5af67388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:42.598443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60758879-3108-428b-9be1-2d8a5af67388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:42.611754 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60758879-3108-428b-9be1-2d8a5af67388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:42.617802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60758879-3108-428b-9be1-2d8a5af67388 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:42.655028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277358a9-8b15-4409-904e-c3d463dbf49c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:42.670991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 888/1800] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:42.670991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60758879-3108-428b-9be1-2d8a5af67388 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:42.673793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-277358a9-8b15-4409-904e-c3d463dbf49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:42.701627 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60758879-3108-428b-9be1-2d8a5af67388 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:42.719685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac80cb-acad-4895-bb7f-fdc345664253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:42.722245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac80cb-acad-4895-bb7f-fdc345664253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:42.722624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac80cb-acad-4895-bb7f-fdc345664253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:42.726151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac80cb-acad-4895-bb7f-fdc345664253 admin admin] PATH_INFO: `/v3/projects/4f1118f1bdda4861b568af2ab4f9ce70/users/a0462b943c37403a8d3979f6020f274d/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:42.796441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac80cb-acad-4895-bb7f-fdc345664253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1118f1bdda4861b568af2ab4f9ce70, user_id=a0462b943c37403a8d3979f6020f274d, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:42.809320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277358a9-8b15-4409-904e-c3d463dbf49c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:42.809498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac80cb-acad-4895-bb7f-fdc345664253 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:42.822743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:42.823723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:42.824234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:42.824715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:42.829506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:42.929494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 889/1801] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:42 2022] PUT /identity/v3/projects/4f1118f1bdda4861b568af2ab4f9ce70/users/a0462b943c37403a8d3979f6020f274d/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:42.941814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c93d9-2b9c-46f8-89af-6e466c05fd68 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:42.942178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c93d9-2b9c-46f8-89af-6e466c05fd68 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:42.942419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c93d9-2b9c-46f8-89af-6e466c05fd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:43.091982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-041c93d9-2b9c-46f8-89af-6e466c05fd68 None None] MFA Rules not processed for user `a0462b943c37403a8d3979f6020f274d`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:43.093337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-041c93d9-2b9c-46f8-89af-6e466c05fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:43.133970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:43.136008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:43.161578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 913/1802] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:43.287923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 890/1803] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:43.551651 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:43.553582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:43.575097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a65de4-4248-4ebc-b93e-3c156a3e30e9 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:43.635386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a21f54-235d-4cff-ad85-ef951bcc8c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:43.636126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a21f54-235d-4cff-ad85-ef951bcc8c14 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:43.636502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a21f54-235d-4cff-ad85-ef951bcc8c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:43.636933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a21f54-235d-4cff-ad85-ef951bcc8c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:43.664203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a21f54-235d-4cff-ad85-ef951bcc8c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:43.668004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a21f54-235d-4cff-ad85-ef951bcc8c14 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:43.684362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 914/1804] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:43.707492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c93d9-2b9c-46f8-89af-6e466c05fd68 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:43.755365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a21f54-235d-4cff-ad85-ef951bcc8c14 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:43.757466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-11a21f54-235d-4cff-ad85-ef951bcc8c14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:43.852320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c93d9-2b9c-46f8-89af-6e466c05fd68 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:43.853602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a21f54-235d-4cff-ad85-ef951bcc8c14 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:43.861317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:43.862583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:43.862829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:43.863198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] PATH_INFO: `/v3/users/a0462b943c37403a8d3979f6020f274d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:43.866775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0462b943c37403a8d3979f6020f274d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:43.866929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:43.867909 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:43.870225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:43.871533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] PATH_INFO: `/v3/users/3d8405189360405f980ede24024f2059` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:43.873732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8405189360405f980ede24024f2059)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:43.877353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:43.878254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:44.119400 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8405189360405f980ede24024f2059'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.120234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8405189360405f980ede24024f2059'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.120852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8405189360405f980ede24024f2059'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.137856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8405189360405f980ede24024f2059'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.145938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c877cc37-a9b9-412f-9742-2408cdde1c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8405189360405f980ede24024f2059'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.234614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0462b943c37403a8d3979f6020f274d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.235958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0462b943c37403a8d3979f6020f274d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.269019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 915/1805] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:43 2022] DELETE /identity/v3/users/3d8405189360405f980ede24024f2059 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:44.269533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0462b943c37403a8d3979f6020f274d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.272186 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0462b943c37403a8d3979f6020f274d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.275108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdf63f-7c55-4ca3-829a-f460bb1bb92c None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:44.275568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdf63f-7c55-4ca3-829a-f460bb1bb92c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:44.276444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdf63f-7c55-4ca3-829a-f460bb1bb92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:44.281010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a65c4448-aaa7-4e7d-93bb-4fc3aeefd74c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0462b943c37403a8d3979f6020f274d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:44.305898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-5ccdf63f-7c55-4ca3-829a-f460bb1bb92c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:44.307171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5ccdf63f-7c55-4ca3-829a-f460bb1bb92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:44.384779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 891/1806] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:43 2022] DELETE /identity/v3/users/a0462b943c37403a8d3979f6020f274d => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:44.390333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7436fe4-43e6-4848-af56-b3898d02fba8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:44.390624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7436fe4-43e6-4848-af56-b3898d02fba8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:44.391656 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7436fe4-43e6-4848-af56-b3898d02fba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:44.422384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 916/1807] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:44.426405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e7436fe4-43e6-4848-af56-b3898d02fba8 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:44.427766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e7436fe4-43e6-4848-af56-b3898d02fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:44.432653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdf63f-7c55-4ca3-829a-f460bb1bb92c None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:44.435269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5ccdf63f-7c55-4ca3-829a-f460bb1bb92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:44.537557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 892/1808] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:44.543146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdf63f-7c55-4ca3-829a-f460bb1bb92c None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:44.562890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7436fe4-43e6-4848-af56-b3898d02fba8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:44.654650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cbbb8-22a2-4d6e-9c34-a12534137624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:44.656264 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cbbb8-22a2-4d6e-9c34-a12534137624 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:44.656707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cbbb8-22a2-4d6e-9c34-a12534137624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:44.657126 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cbbb8-22a2-4d6e-9c34-a12534137624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:44.672789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cbbb8-22a2-4d6e-9c34-a12534137624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:44.674604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cbbb8-22a2-4d6e-9c34-a12534137624 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:44.689374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 917/1809] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:15:44.691251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7436fe4-43e6-4848-af56-b3898d02fba8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:44.701522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf141b49-4645-4b5e-8204-68c043788c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:44.702234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf141b49-4645-4b5e-8204-68c043788c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:44.702550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf141b49-4645-4b5e-8204-68c043788c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:44.702826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf141b49-4645-4b5e-8204-68c043788c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:44.724386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf141b49-4645-4b5e-8204-68c043788c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:44.725864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf141b49-4645-4b5e-8204-68c043788c93 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:44.746582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 893/1810] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:45.050447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abda87-0a03-4ad8-a139-b591295d9728 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:45.050894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abda87-0a03-4ad8-a139-b591295d9728 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:45.051399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abda87-0a03-4ad8-a139-b591295d9728 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:45.056479 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 918/1811] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:15:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:45.069246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345220a5-ddac-4ad9-a081-d823b93e8c3e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:45.069537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345220a5-ddac-4ad9-a081-d823b93e8c3e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:45.069809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345220a5-ddac-4ad9-a081-d823b93e8c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:45.111113 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-345220a5-ddac-4ad9-a081-d823b93e8c3e None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:45.112393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-345220a5-ddac-4ad9-a081-d823b93e8c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:45.260861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 894/1812] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:15:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:45.282190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abda87-0a03-4ad8-a139-b591295d9728 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:45.284492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-00abda87-0a03-4ad8-a139-b591295d9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:45.322577 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abda87-0a03-4ad8-a139-b591295d9728 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:45.329591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0458a6-b49d-430e-a7f8-795e8d715186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:45.330779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0458a6-b49d-430e-a7f8-795e8d715186 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:45.331346 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0458a6-b49d-430e-a7f8-795e8d715186 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:45.331759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0458a6-b49d-430e-a7f8-795e8d715186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:45.343960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0458a6-b49d-430e-a7f8-795e8d715186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:45.345801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0458a6-b49d-430e-a7f8-795e8d715186 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:45.362726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 919/1813] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:45.440003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345220a5-ddac-4ad9-a081-d823b93e8c3e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:45.441651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-345220a5-ddac-4ad9-a081-d823b93e8c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:45.456182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345220a5-ddac-4ad9-a081-d823b93e8c3e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:45.461766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:45.463931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:45.464429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:45.464902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] PATH_INFO: `/v3/projects/4f1118f1bdda4861b568af2ab4f9ce70` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:45.472336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1118f1bdda4861b568af2ab4f9ce70)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:45.483142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:45.631914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0458a6-b49d-430e-a7f8-795e8d715186 service nova] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:45.633315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4e0458a6-b49d-430e-a7f8-795e8d715186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:45.661273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0458a6-b49d-430e-a7f8-795e8d715186 service nova] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:45.721681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1118f1bdda4861b568af2ab4f9ce70', 'request_id': 'req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:45.734807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1118f1bdda4861b568af2ab4f9ce70', 'request_id': 'req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:45.777481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1118f1bdda4861b568af2ab4f9ce70', 'request_id': 'req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:45.803213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:45.804359 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:45.804728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:45.805181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] PATH_INFO: `/v3/projects/991ae24cf98248cc9456b13700b2e16d` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:45.807451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991ae24cf98248cc9456b13700b2e16d)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:45.810618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:45.865354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] The token cache is being invalidate because project 4f1118f1bdda4861b568af2ab4f9ce70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:45.865703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:45.866500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:45.868580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 895/1814] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:45 2022] DELETE /identity/v3/projects/4f1118f1bdda4861b568af2ab4f9ce70 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:45.871190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:45.873783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:45.888127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8f4d7-405b-4b1e-8ca9-892240145a8c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:45.910730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991ae24cf98248cc9456b13700b2e16d', 'request_id': 'req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:45.963139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:45.964082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:45.964417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:45.964827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] PATH_INFO: `/v3/users/94543c3e1f774eb48daddbce100dcc08` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:45.966244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] RBAC: Authorizing `identity:delete_user(user_id=94543c3e1f774eb48daddbce100dcc08)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:45.968504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:45.986142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991ae24cf98248cc9456b13700b2e16d', 'request_id': 'req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:45.992732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991ae24cf98248cc9456b13700b2e16d', 'request_id': 'req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.029431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] The token cache is being invalidate because project 991ae24cf98248cc9456b13700b2e16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:46.031052 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.032746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-38cc6ba3-bfe9-43ee-8720-1ef57b0912a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.036635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 920/1815] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:45 2022] DELETE /identity/v3/projects/991ae24cf98248cc9456b13700b2e16d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:46.039355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4df92-4410-42b9-b300-b4250296f010 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:46.039860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4df92-4410-42b9-b300-b4250296f010 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:46.040222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4df92-4410-42b9-b300-b4250296f010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:46.065649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-16d4df92-4410-42b9-b300-b4250296f010 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:46.067256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-16d4df92-4410-42b9-b300-b4250296f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:46.088621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 921/1816] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:46.090997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4df92-4410-42b9-b300-b4250296f010 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:46.092855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-16d4df92-4410-42b9-b300-b4250296f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:46.106976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4df92-4410-42b9-b300-b4250296f010 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:46.113091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:46.114444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:46.114790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:46.115129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] PATH_INFO: `/v3/users/cd17761108b74a6aa3b63861d9c56d15` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:46.116472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd17761108b74a6aa3b63861d9c56d15)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:46.118508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:46.215754 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94543c3e1f774eb48daddbce100dcc08'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.217501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94543c3e1f774eb48daddbce100dcc08'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.245156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94543c3e1f774eb48daddbce100dcc08'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.247204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94543c3e1f774eb48daddbce100dcc08'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.272908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7e3386c3-2192-4843-ade8-8fb02823821a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94543c3e1f774eb48daddbce100dcc08'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.344075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd17761108b74a6aa3b63861d9c56d15'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.345256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd17761108b74a6aa3b63861d9c56d15'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.345906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd17761108b74a6aa3b63861d9c56d15'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.361511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd17761108b74a6aa3b63861d9c56d15'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.372351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd17761108b74a6aa3b63861d9c56d15'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:46.382036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 896/1817] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:45 2022] DELETE /identity/v3/users/94543c3e1f774eb48daddbce100dcc08 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:46.383989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710bfdd-0c12-49cd-aeb4-e9b237dd8af4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:46.384472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710bfdd-0c12-49cd-aeb4-e9b237dd8af4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:46.384958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710bfdd-0c12-49cd-aeb4-e9b237dd8af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:46.407536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a710bfdd-0c12-49cd-aeb4-e9b237dd8af4 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:46.409036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a710bfdd-0c12-49cd-aeb4-e9b237dd8af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:46.500746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 897/1818] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:46.502447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504193f4-dcaa-4902-9ee5-6e10c6e7401f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:46.502744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504193f4-dcaa-4902-9ee5-6e10c6e7401f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:46.503028 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504193f4-dcaa-4902-9ee5-6e10c6e7401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:46.523028 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-504193f4-dcaa-4902-9ee5-6e10c6e7401f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:46.524230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-504193f4-dcaa-4902-9ee5-6e10c6e7401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:46.536476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 898/1819] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:46.536476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504193f4-dcaa-4902-9ee5-6e10c6e7401f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:46.549630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504193f4-dcaa-4902-9ee5-6e10c6e7401f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:46.555987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c766f5-8545-4149-bfe8-8582d5a3360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:46.557331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c766f5-8545-4149-bfe8-8582d5a3360f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:46.558014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c766f5-8545-4149-bfe8-8582d5a3360f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:46.558516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c766f5-8545-4149-bfe8-8582d5a3360f admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:46.560181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c766f5-8545-4149-bfe8-8582d5a3360f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:46.561022 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c766f5-8545-4149-bfe8-8582d5a3360f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:46.564142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c766f5-8545-4149-bfe8-8582d5a3360f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:46.567401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 922/1820] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:46 2022] DELETE /identity/v3/users/cd17761108b74a6aa3b63861d9c56d15 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:46.573171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:46.576092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:46.601223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 899/1821] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:46.602908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c766f5-8545-4149-bfe8-8582d5a3360f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:46.621084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c766f5-8545-4149-bfe8-8582d5a3360f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:46.673525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8514-6bcf-4832-a445-73a3fbea25e2 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:46.679164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13064ba0-3dfd-4469-b45c-d731c791891f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:46.679843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13064ba0-3dfd-4469-b45c-d731c791891f service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:46.680125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13064ba0-3dfd-4469-b45c-d731c791891f service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:46.680554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13064ba0-3dfd-4469-b45c-d731c791891f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:46.724279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d278060-cbd5-4e2d-acad-3eef9c206808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:46.725301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d278060-cbd5-4e2d-acad-3eef9c206808 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:46.726229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d278060-cbd5-4e2d-acad-3eef9c206808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:46.726818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d278060-cbd5-4e2d-acad-3eef9c206808 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:46.727788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d278060-cbd5-4e2d-acad-3eef9c206808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:46.731533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d278060-cbd5-4e2d-acad-3eef9c206808 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:46.793483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13064ba0-3dfd-4469-b45c-d731c791891f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:46.795484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13064ba0-3dfd-4469-b45c-d731c791891f service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:46.814633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 923/1822] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:46.878305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 900/1823] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:46 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:46.882314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13064ba0-3dfd-4469-b45c-d731c791891f service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:46.894677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13064ba0-3dfd-4469-b45c-d731c791891f service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:46.981428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c997d-1759-4e3d-8707-c10bd0886bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:46.982353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c997d-1759-4e3d-8707-c10bd0886bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:46.982638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c997d-1759-4e3d-8707-c10bd0886bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:46.982914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c997d-1759-4e3d-8707-c10bd0886bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:46.983874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c997d-1759-4e3d-8707-c10bd0886bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:46.986701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c997d-1759-4e3d-8707-c10bd0886bd5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:47.140872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 924/1824] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:46 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:47.141051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d278060-cbd5-4e2d-acad-3eef9c206808 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:47.148846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d278060-cbd5-4e2d-acad-3eef9c206808 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:47.153338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf081f-19ca-409f-b0b5-4ba2a4e3acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:47.153992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf081f-19ca-409f-b0b5-4ba2a4e3acb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:47.154315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf081f-19ca-409f-b0b5-4ba2a4e3acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:47.154586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf081f-19ca-409f-b0b5-4ba2a4e3acb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:47.155335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf081f-19ca-409f-b0b5-4ba2a4e3acb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:47.167504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf081f-19ca-409f-b0b5-4ba2a4e3acb0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:47.175584 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 901/1825] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:15:47.179626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c997d-1759-4e3d-8707-c10bd0886bd5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:47.192398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c997d-1759-4e3d-8707-c10bd0886bd5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:47.198389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb5be0-ec7f-4a9b-a738-2a89e33c4974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:47.199141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb5be0-ec7f-4a9b-a738-2a89e33c4974 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:47.199430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb5be0-ec7f-4a9b-a738-2a89e33c4974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:47.199703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb5be0-ec7f-4a9b-a738-2a89e33c4974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:47.200483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb5be0-ec7f-4a9b-a738-2a89e33c4974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:47.202782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb5be0-ec7f-4a9b-a738-2a89e33c4974 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:47.221923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 925/1826] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:47.222015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf081f-19ca-409f-b0b5-4ba2a4e3acb0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:47.232117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf081f-19ca-409f-b0b5-4ba2a4e3acb0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:47.246755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0765a-d140-46f4-81f8-e49154d97648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:47.247666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0765a-d140-46f4-81f8-e49154d97648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:47.247944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0765a-d140-46f4-81f8-e49154d97648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:47.248213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0765a-d140-46f4-81f8-e49154d97648 admin admin] PATH_INFO: `/v3/projects/9811f9580e1340698b940f81b961111c/users/2621da2724654fbbb4b693c483584310/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:47.277919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0765a-d140-46f4-81f8-e49154d97648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9811f9580e1340698b940f81b961111c, user_id=2621da2724654fbbb4b693c483584310, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:47.283616 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0765a-d140-46f4-81f8-e49154d97648 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:47.418325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 902/1827] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:47 2022] PUT /identity/v3/projects/9811f9580e1340698b940f81b961111c/users/2621da2724654fbbb4b693c483584310/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:47.429240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884454d-eb0c-4e61-8ed0-f64f25fd7f32 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:47.429715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884454d-eb0c-4e61-8ed0-f64f25fd7f32 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:47.429811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884454d-eb0c-4e61-8ed0-f64f25fd7f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:47.489911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f884454d-eb0c-4e61-8ed0-f64f25fd7f32 None None] MFA Rules not processed for user `2621da2724654fbbb4b693c483584310`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:47.495659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f884454d-eb0c-4e61-8ed0-f64f25fd7f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:47.577269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 926/1828] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:47.587758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0765a-d140-46f4-81f8-e49154d97648 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:47.589488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-74e0765a-d140-46f4-81f8-e49154d97648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:47.648557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884454d-eb0c-4e61-8ed0-f64f25fd7f32 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:47.650377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f884454d-eb0c-4e61-8ed0-f64f25fd7f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:47.705027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0765a-d140-46f4-81f8-e49154d97648 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:47.731218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87324c74-4e18-48a2-b907-c9708d0ea51c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:47.732108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87324c74-4e18-48a2-b907-c9708d0ea51c service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:47.732898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87324c74-4e18-48a2-b907-c9708d0ea51c service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:47.743390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87324c74-4e18-48a2-b907-c9708d0ea51c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:47.761422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87324c74-4e18-48a2-b907-c9708d0ea51c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:47.763099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87324c74-4e18-48a2-b907-c9708d0ea51c service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:47.789541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 903/1829] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:47.794699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87324c74-4e18-48a2-b907-c9708d0ea51c service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:47.800154 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-87324c74-4e18-48a2-b907-c9708d0ea51c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:47.845202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884454d-eb0c-4e61-8ed0-f64f25fd7f32 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:47.858733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:47.859598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:47.859868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:47.860138 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] PATH_INFO: `/v3/projects/1388742216b24f518f39f59d78d63deb` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:47.861361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1388742216b24f518f39f59d78d63deb)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:47.863299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:47.912271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87324c74-4e18-48a2-b907-c9708d0ea51c service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:47.916914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:47.917768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:47.918042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:47.918357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] PATH_INFO: `/v3/projects/ebb569ed838844218ec6199c871f404b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:47.919603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb569ed838844218ec6199c871f404b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:47.921660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:47.980672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1388742216b24f518f39f59d78d63deb', 'request_id': 'req-120a9dc7-1472-4fa6-834e-8f334ee2f338'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.064148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1388742216b24f518f39f59d78d63deb', 'request_id': 'req-120a9dc7-1472-4fa6-834e-8f334ee2f338'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.066966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb569ed838844218ec6199c871f404b', 'request_id': 'req-a8db025d-e912-4b7b-b6c2-d9477a352b16'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.071973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1388742216b24f518f39f59d78d63deb', 'request_id': 'req-120a9dc7-1472-4fa6-834e-8f334ee2f338'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.083224 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb569ed838844218ec6199c871f404b', 'request_id': 'req-a8db025d-e912-4b7b-b6c2-d9477a352b16'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.092470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb569ed838844218ec6199c871f404b', 'request_id': 'req-a8db025d-e912-4b7b-b6c2-d9477a352b16'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.099905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] The token cache is being invalidate because project 1388742216b24f518f39f59d78d63deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:48.100187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.100855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.102775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 927/1830] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:47 2022] DELETE /identity/v3/projects/1388742216b24f518f39f59d78d63deb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:48.106549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:48.109236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:48.194452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a9dc7-1472-4fa6-834e-8f334ee2f338 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:48.253666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:48.254568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:48.254846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:48.255117 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] PATH_INFO: `/v3/users/b9e10290bccf4c2da32d5e2e1e88764e` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:48.256315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e10290bccf4c2da32d5e2e1e88764e)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:48.258420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:48.287158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] The token cache is being invalidate because project ebb569ed838844218ec6199c871f404b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:48.287445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.288148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a8db025d-e912-4b7b-b6c2-d9477a352b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.289896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 904/1831] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:47 2022] DELETE /identity/v3/projects/ebb569ed838844218ec6199c871f404b => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:48.295785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db1ae8-ee26-479a-b92e-3f39f932fcc3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:48.296318 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db1ae8-ee26-479a-b92e-3f39f932fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:48.296693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db1ae8-ee26-479a-b92e-3f39f932fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:48.341838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-91db1ae8-ee26-479a-b92e-3f39f932fcc3 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:48.341838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-91db1ae8-ee26-479a-b92e-3f39f932fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:48.355988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 905/1832] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:48.357594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5ed99-f3d7-4a6a-a330-7aab1688c1e8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:48.357882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5ed99-f3d7-4a6a-a330-7aab1688c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:48.358257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5ed99-f3d7-4a6a-a330-7aab1688c1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:48.376195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0ec5ed99-f3d7-4a6a-a330-7aab1688c1e8 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:48.377358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0ec5ed99-f3d7-4a6a-a330-7aab1688c1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:48.385133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 906/1833] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:48.390197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5ed99-f3d7-4a6a-a330-7aab1688c1e8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:48.398946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5ed99-f3d7-4a6a-a330-7aab1688c1e8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:48.403593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:48.404236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:48.404517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:48.404790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:48.405532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:48.405864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:48.407614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:48.428620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 907/1834] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:48.429402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e10290bccf4c2da32d5e2e1e88764e'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.432390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e10290bccf4c2da32d5e2e1e88764e'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.433423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:48.434773 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e10290bccf4c2da32d5e2e1e88764e'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.437094 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:48.448259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e10290bccf4c2da32d5e2e1e88764e'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.451133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5af46-3d70-43e7-865f-507661be8eae admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:48.458273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e10290bccf4c2da32d5e2e1e88764e'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.458366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a17ef-07d6-4be1-bd39-6477d31ba880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:48.458366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a17ef-07d6-4be1-bd39-6477d31ba880 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:48.458642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a17ef-07d6-4be1-bd39-6477d31ba880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:48.458977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a17ef-07d6-4be1-bd39-6477d31ba880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:48.459730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a17ef-07d6-4be1-bd39-6477d31ba880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:48.461671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a17ef-07d6-4be1-bd39-6477d31ba880 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:48.541118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 928/1835] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:48 2022] DELETE /identity/v3/users/b9e10290bccf4c2da32d5e2e1e88764e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:48.542137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:48.543595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:48.600266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 908/1836] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:48 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:15:48.609927 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a17ef-07d6-4be1-bd39-6477d31ba880 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:48.650642 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1b345-2439-4738-8fca-841318a371ea admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:48.689127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a17ef-07d6-4be1-bd39-6477d31ba880 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:48.710618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a020fb-39d5-4ad8-9b37-62234d37c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:48.713669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a020fb-39d5-4ad8-9b37-62234d37c145 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:48.716802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a020fb-39d5-4ad8-9b37-62234d37c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:48.716802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a020fb-39d5-4ad8-9b37-62234d37c145 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:48.716802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a020fb-39d5-4ad8-9b37-62234d37c145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:48.721529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a020fb-39d5-4ad8-9b37-62234d37c145 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:48.738442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:48.741344 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:48.741634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:48.741911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] PATH_INFO: `/v3/users/a1916f6b316249268ed1513110154ae3` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:48.745754 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1916f6b316249268ed1513110154ae3)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:48.757165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:48.874494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 909/1837] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:48 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:48.875832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a020fb-39d5-4ad8-9b37-62234d37c145 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:48.892398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a020fb-39d5-4ad8-9b37-62234d37c145 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:48.906538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62604f76-fe86-46cd-9b7f-b5fe55706554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:48.907231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62604f76-fe86-46cd-9b7f-b5fe55706554 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:48.907522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62604f76-fe86-46cd-9b7f-b5fe55706554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:48.907789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62604f76-fe86-46cd-9b7f-b5fe55706554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:48.908527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62604f76-fe86-46cd-9b7f-b5fe55706554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:48.913045 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62604f76-fe86-46cd-9b7f-b5fe55706554 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:48.928287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 910/1838] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:15:48.932384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62604f76-fe86-46cd-9b7f-b5fe55706554 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:48.944303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62604f76-fe86-46cd-9b7f-b5fe55706554 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:48.954322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1916f6b316249268ed1513110154ae3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.955301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1916f6b316249268ed1513110154ae3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.956237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1916f6b316249268ed1513110154ae3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.960904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5db8-12f3-4871-b7d1-d9c1c413c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:48.962135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5db8-12f3-4871-b7d1-d9c1c413c793 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:48.962529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5db8-12f3-4871-b7d1-d9c1c413c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:48.963021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5db8-12f3-4871-b7d1-d9c1c413c793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:48.963855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c5db8-12f3-4871-b7d1-d9c1c413c793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:48.966933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c5db8-12f3-4871-b7d1-d9c1c413c793 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:48.977821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1916f6b316249268ed1513110154ae3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:48.983383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 911/1839] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:15:48.984397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5db8-12f3-4871-b7d1-d9c1c413c793 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:48.986341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-de9c5db8-12f3-4871-b7d1-d9c1c413c793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:48.991567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1916f6b316249268ed1513110154ae3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:49.010224 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5db8-12f3-4871-b7d1-d9c1c413c793 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:49.017937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf6c12-1d6f-4d5e-9f08-f35a26405ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:49.019050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf6c12-1d6f-4d5e-9f08-f35a26405ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.019337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf6c12-1d6f-4d5e-9f08-f35a26405ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.019617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf6c12-1d6f-4d5e-9f08-f35a26405ba6 admin admin] PATH_INFO: `/v3/projects/c282449b6d684b62b5dcf90f4a776178/users/24494e8d530e43989c668fdd613745eb/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.040730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf6c12-1d6f-4d5e-9f08-f35a26405ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c282449b6d684b62b5dcf90f4a776178, user_id=24494e8d530e43989c668fdd613745eb, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:49.044459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf6c12-1d6f-4d5e-9f08-f35a26405ba6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:49.106570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 929/1840] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:48 2022] DELETE /identity/v3/users/a1916f6b316249268ed1513110154ae3 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:49.106570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:49.110607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.193702 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f7ee9-e562-4187-9741-83ed5cb93bb1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:49.199339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:49.200519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.201023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.201715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] PATH_INFO: `/v3/projects/b75b0ce1a551469bbead327073a360b7` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.204308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75b0ce1a551469bbead327073a360b7)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:49.206681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:49.211819 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 912/1841] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:48 2022] PUT /identity/v3/projects/c282449b6d684b62b5dcf90f4a776178/users/24494e8d530e43989c668fdd613745eb/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:49.224572 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ec81-6601-4321-bb61-9f8cfc7991cd None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.224866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ec81-6601-4321-bb61-9f8cfc7991cd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.225145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ec81-6601-4321-bb61-9f8cfc7991cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.245296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f065ec81-6601-4321-bb61-9f8cfc7991cd None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:49.247068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f065ec81-6601-4321-bb61-9f8cfc7991cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.320832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 913/1842] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:49.323962 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13808682-4558-46a8-a89d-0436489701b1 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.324683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13808682-4558-46a8-a89d-0436489701b1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.326633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13808682-4558-46a8-a89d-0436489701b1 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.328861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 914/1843] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:15:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:15:49.330295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6cce1-7bb7-4c9f-93b1-ab3bdff633b8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.330731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6cce1-7bb7-4c9f-93b1-ab3bdff633b8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.331150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6cce1-7bb7-4c9f-93b1-ab3bdff633b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.374977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-69a6cce1-7bb7-4c9f-93b1-ab3bdff633b8 None None] MFA Rules not processed for user `24494e8d530e43989c668fdd613745eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:49.377296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-69a6cce1-7bb7-4c9f-93b1-ab3bdff633b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.384741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75b0ce1a551469bbead327073a360b7', 'request_id': 'req-8d189978-4c57-4d67-b098-dcd39b4802af'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:49.469464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 915/1844] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:49.470565 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6cce1-7bb7-4c9f-93b1-ab3bdff633b8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:49.471987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-69a6cce1-7bb7-4c9f-93b1-ab3bdff633b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75b0ce1a551469bbead327073a360b7', 'request_id': 'req-8d189978-4c57-4d67-b098-dcd39b4802af'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:49.491166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75b0ce1a551469bbead327073a360b7', 'request_id': 'req-8d189978-4c57-4d67-b098-dcd39b4802af'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:49.531645 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] The token cache is being invalidate because project b75b0ce1a551469bbead327073a360b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:49.532517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:49.536268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8d189978-4c57-4d67-b098-dcd39b4802af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:49.539955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 930/1845] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:49 2022] DELETE /identity/v3/projects/b75b0ce1a551469bbead327073a360b7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:49.541903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b406-6004-44b1-8aaf-f5c4dfba6fe6 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.543755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b406-6004-44b1-8aaf-f5c4dfba6fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.548105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b406-6004-44b1-8aaf-f5c4dfba6fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.563107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6cce1-7bb7-4c9f-93b1-ab3bdff633b8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:49.569706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:49.570745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.571024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.571349 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.574569 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.588379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-1e39b406-6004-44b1-8aaf-f5c4dfba6fe6 None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:49.589959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1e39b406-6004-44b1-8aaf-f5c4dfba6fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.708720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:49.711771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:49.725823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 916/1846] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:49.727016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:49.729088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.743518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70c51-0b01-40ae-88c4-7a8d2962b0a5 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:49.749546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47c0d0-dfcd-47f2-9e8a-be494605aafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:49.750648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47c0d0-dfcd-47f2-9e8a-be494605aafe admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.751195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47c0d0-dfcd-47f2-9e8a-be494605aafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.751481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47c0d0-dfcd-47f2-9e8a-be494605aafe admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.752446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 931/1847] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:15:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:49.752582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47c0d0-dfcd-47f2-9e8a-be494605aafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:49.753713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324366bb-68c7-4214-bcd7-5573d5626c11 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.754120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324366bb-68c7-4214-bcd7-5573d5626c11 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.754596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324366bb-68c7-4214-bcd7-5573d5626c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.754707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47c0d0-dfcd-47f2-9e8a-be494605aafe admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:49.778275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-324366bb-68c7-4214-bcd7-5573d5626c11 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:49.779622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-324366bb-68c7-4214-bcd7-5573d5626c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.788181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 932/1848] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:49.788994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324366bb-68c7-4214-bcd7-5573d5626c11 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:49.793284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-324366bb-68c7-4214-bcd7-5573d5626c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.813134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324366bb-68c7-4214-bcd7-5573d5626c11 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:49.819232 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025c6ce-8305-4db7-b283-300bc3ae3e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:49.822164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025c6ce-8305-4db7-b283-300bc3ae3e00 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.822164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025c6ce-8305-4db7-b283-300bc3ae3e00 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.822164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025c6ce-8305-4db7-b283-300bc3ae3e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.838132 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025c6ce-8305-4db7-b283-300bc3ae3e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:49.839820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025c6ce-8305-4db7-b283-300bc3ae3e00 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:49.853305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 933/1849] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:49.854654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969c1e-9726-4706-8bb6-e3bc6ea8d0af None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.854943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969c1e-9726-4706-8bb6-e3bc6ea8d0af None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.855221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969c1e-9726-4706-8bb6-e3bc6ea8d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.873333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e1969c1e-9726-4706-8bb6-e3bc6ea8d0af None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:49.875112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e1969c1e-9726-4706-8bb6-e3bc6ea8d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:49.883306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 934/1850] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:49.887440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1969c1e-9726-4706-8bb6-e3bc6ea8d0af None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:49.894720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 917/1851] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:49 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:49.895822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47c0d0-dfcd-47f2-9e8a-be494605aafe admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:49.897307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1969c1e-9726-4706-8bb6-e3bc6ea8d0af None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:49.985594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a73c9f-b1e3-4d22-a85f-89ee02753207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:49.986333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a73c9f-b1e3-4d22-a85f-89ee02753207 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.986626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a73c9f-b1e3-4d22-a85f-89ee02753207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.986911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a73c9f-b1e3-4d22-a85f-89ee02753207 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.987644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a73c9f-b1e3-4d22-a85f-89ee02753207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:49.987952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a73c9f-b1e3-4d22-a85f-89ee02753207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:49.988240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47c0d0-dfcd-47f2-9e8a-be494605aafe admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:49.989813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a73c9f-b1e3-4d22-a85f-89ee02753207 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:49.994145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82850cc-dc9a-4cd4-9697-d135660d7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:49.994808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82850cc-dc9a-4cd4-9697-d135660d7d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:49.995182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82850cc-dc9a-4cd4-9697-d135660d7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:49.995552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82850cc-dc9a-4cd4-9697-d135660d7d4c admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:49.996345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82850cc-dc9a-4cd4-9697-d135660d7d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:49.998589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82850cc-dc9a-4cd4-9697-d135660d7d4c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.008363 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 935/1852] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:15:50.012705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a73c9f-b1e3-4d22-a85f-89ee02753207 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.024998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a73c9f-b1e3-4d22-a85f-89ee02753207 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.031202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6d752-3684-419a-8b8e-307b104331ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.031879 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6d752-3684-419a-8b8e-307b104331ee admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.032149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6d752-3684-419a-8b8e-307b104331ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.032425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6d752-3684-419a-8b8e-307b104331ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.033596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6d752-3684-419a-8b8e-307b104331ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.035548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6d752-3684-419a-8b8e-307b104331ee admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.156280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 918/1853] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:49 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:50.159975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82850cc-dc9a-4cd4-9697-d135660d7d4c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.169954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82850cc-dc9a-4cd4-9697-d135660d7d4c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.176334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaa842-d7e0-4688-9247-858f107d7e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.177095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaa842-d7e0-4688-9247-858f107d7e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.177450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaa842-d7e0-4688-9247-858f107d7e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.177822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaa842-d7e0-4688-9247-858f107d7e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.178642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaa842-d7e0-4688-9247-858f107d7e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.180303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaa842-d7e0-4688-9247-858f107d7e4e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.191134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 919/1854] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:15:50.198590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaa842-d7e0-4688-9247-858f107d7e4e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.210751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaa842-d7e0-4688-9247-858f107d7e4e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.215158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 936/1855] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:50 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:15:50.222788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eb2bf-50d8-420c-9f47-0dd438f96c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.222788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eb2bf-50d8-420c-9f47-0dd438f96c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.223009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6d752-3684-419a-8b8e-307b104331ee admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.223086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eb2bf-50d8-420c-9f47-0dd438f96c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.223086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eb2bf-50d8-420c-9f47-0dd438f96c66 admin admin] PATH_INFO: `/v3/projects/4b8ff636c0824f359d4a617b77ce0403/users/81595384f6ff4b479781d2559c601654/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.243309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900eb2bf-50d8-420c-9f47-0dd438f96c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8ff636c0824f359d4a617b77ce0403, user_id=81595384f6ff4b479781d2559c601654, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.246181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900eb2bf-50d8-420c-9f47-0dd438f96c66 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.305431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6d752-3684-419a-8b8e-307b104331ee admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.310073 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb8f1-8a45-430d-94d0-3608fefd259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.310741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb8f1-8a45-430d-94d0-3608fefd259a admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.311022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb8f1-8a45-430d-94d0-3608fefd259a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.312077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb8f1-8a45-430d-94d0-3608fefd259a admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.312760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eb8f1-8a45-430d-94d0-3608fefd259a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.314703 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eb8f1-8a45-430d-94d0-3608fefd259a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.372818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 920/1856] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:50 2022] PUT /identity/v3/projects/4b8ff636c0824f359d4a617b77ce0403/users/81595384f6ff4b479781d2559c601654/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:50.373651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eb2bf-50d8-420c-9f47-0dd438f96c66 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.375987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-900eb2bf-50d8-420c-9f47-0dd438f96c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:50.438389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 937/1857] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:50 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:50.438389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb8f1-8a45-430d-94d0-3608fefd259a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.438662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eb2bf-50d8-420c-9f47-0dd438f96c66 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.442948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.443873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.444221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.444499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] PATH_INFO: `/v3/projects/782e18c7424c4d15b1cd20519830fe65` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.445626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb8f1-8a45-430d-94d0-3608fefd259a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.445733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] RBAC: Authorizing `identity:delete_project(project_id=782e18c7424c4d15b1cd20519830fe65)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.447886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.450535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a37281-0b0a-43d5-8524-83833695258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.451188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a37281-0b0a-43d5-8524-83833695258a admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.451468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a37281-0b0a-43d5-8524-83833695258a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.451738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a37281-0b0a-43d5-8524-83833695258a admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.452515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a37281-0b0a-43d5-8524-83833695258a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.454109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a37281-0b0a-43d5-8524-83833695258a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.463928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 938/1858] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:50.464710 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a37281-0b0a-43d5-8524-83833695258a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.474336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a37281-0b0a-43d5-8524-83833695258a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.479132 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bdf6e-1563-40de-8c27-e1579084a127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.479711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bdf6e-1563-40de-8c27-e1579084a127 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.479990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bdf6e-1563-40de-8c27-e1579084a127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.480265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bdf6e-1563-40de-8c27-e1579084a127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.480977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bdf6e-1563-40de-8c27-e1579084a127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.482578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bdf6e-1563-40de-8c27-e1579084a127 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.494454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 939/1859] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:50.495207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bdf6e-1563-40de-8c27-e1579084a127 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.504387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bdf6e-1563-40de-8c27-e1579084a127 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.509069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead13bd-e56e-4168-88dd-a1f170a14d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.509934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead13bd-e56e-4168-88dd-a1f170a14d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.510342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead13bd-e56e-4168-88dd-a1f170a14d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.510617 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead13bd-e56e-4168-88dd-a1f170a14d24 admin admin] PATH_INFO: `/v3/projects/4b8ff636c0824f359d4a617b77ce0403/users/81595384f6ff4b479781d2559c601654/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.512552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead13bd-e56e-4168-88dd-a1f170a14d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8ff636c0824f359d4a617b77ce0403, user_id=81595384f6ff4b479781d2559c601654, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.515372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead13bd-e56e-4168-88dd-a1f170a14d24 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.525388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 940/1860] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:50 2022] PUT /identity/v3/projects/4b8ff636c0824f359d4a617b77ce0403/users/81595384f6ff4b479781d2559c601654/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:50.526194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead13bd-e56e-4168-88dd-a1f170a14d24 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.565378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782e18c7424c4d15b1cd20519830fe65', 'request_id': 'req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.571704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782e18c7424c4d15b1cd20519830fe65', 'request_id': 'req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.577105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782e18c7424c4d15b1cd20519830fe65', 'request_id': 'req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.585533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead13bd-e56e-4168-88dd-a1f170a14d24 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.635946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] The token cache is being invalidate because project 782e18c7424c4d15b1cd20519830fe65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:50.636288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.636925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f3520b3-ccc7-4643-b7a2-aa0ea319bafe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.638592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 921/1861] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:50 2022] DELETE /identity/v3/projects/782e18c7424c4d15b1cd20519830fe65 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:50.638712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e315a-389b-4e60-bb1d-88544b865a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.639469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e315a-389b-4e60-bb1d-88544b865a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.639778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e315a-389b-4e60-bb1d-88544b865a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.640002 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d70cd2-54ab-4449-ae6b-ce5afa1e534a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.640115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e315a-389b-4e60-bb1d-88544b865a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.640291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d70cd2-54ab-4449-ae6b-ce5afa1e534a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.640566 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d70cd2-54ab-4449-ae6b-ce5afa1e534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.640780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e315a-389b-4e60-bb1d-88544b865a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.642566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e315a-389b-4e60-bb1d-88544b865a6e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.656409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 941/1862] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:50.656708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e315a-389b-4e60-bb1d-88544b865a6e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.658441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-025e315a-389b-4e60-bb1d-88544b865a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:50.669351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-67d70cd2-54ab-4449-ae6b-ce5afa1e534a None None] MFA Rules not processed for user `81595384f6ff4b479781d2559c601654`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:50.672895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-67d70cd2-54ab-4449-ae6b-ce5afa1e534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:50.681034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e315a-389b-4e60-bb1d-88544b865a6e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.687270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.688156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.688436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.688711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] PATH_INFO: `/v3/users/510f75c56ece417d9fe683af30ed7d23` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.689925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=510f75c56ece417d9fe683af30ed7d23)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.692345 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.749362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 922/1863] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:50.750211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d70cd2-54ab-4449-ae6b-ce5afa1e534a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.755051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-67d70cd2-54ab-4449-ae6b-ce5afa1e534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:50.769150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d70cd2-54ab-4449-ae6b-ce5afa1e534a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.773733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236582f2-b69b-45d6-8fbd-f02d1511f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.774833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236582f2-b69b-45d6-8fbd-f02d1511f48a admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.775116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236582f2-b69b-45d6-8fbd-f02d1511f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.775388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236582f2-b69b-45d6-8fbd-f02d1511f48a admin admin] PATH_INFO: `/v3/projects/a037e2fa528746b5bb0180cfee272a87/users/e8bedfeb9a6d48508f6a200d6a5e585b/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.790522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236582f2-b69b-45d6-8fbd-f02d1511f48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a037e2fa528746b5bb0180cfee272a87, user_id=e8bedfeb9a6d48508f6a200d6a5e585b, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:50.793176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236582f2-b69b-45d6-8fbd-f02d1511f48a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:50.899729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510f75c56ece417d9fe683af30ed7d23'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.899963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 923/1864] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:50 2022] PUT /identity/v3/projects/a037e2fa528746b5bb0180cfee272a87/users/e8bedfeb9a6d48508f6a200d6a5e585b/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:50.900750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236582f2-b69b-45d6-8fbd-f02d1511f48a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:50.900876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510f75c56ece417d9fe683af30ed7d23'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.901422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510f75c56ece417d9fe683af30ed7d23'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.902483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-236582f2-b69b-45d6-8fbd-f02d1511f48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:50.917174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510f75c56ece417d9fe683af30ed7d23'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.923949 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a0447a1e-4aaa-410c-8612-2a549f091aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510f75c56ece417d9fe683af30ed7d23'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:50.972444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236582f2-b69b-45d6-8fbd-f02d1511f48a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:50.976357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:50.977012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:50.977294 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:50.977575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:50.979391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:51.011503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 942/1865] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:50 2022] DELETE /identity/v3/users/510f75c56ece417d9fe683af30ed7d23 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:51.011503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ec408-8852-45e2-bdcd-32715e37690c None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.011864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ec408-8852-45e2-bdcd-32715e37690c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.012245 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ec408-8852-45e2-bdcd-32715e37690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.053068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:51.054667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:51.060603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-bf6ec408-8852-45e2-bdcd-32715e37690c None None] MFA Rules not processed for user `e8bedfeb9a6d48508f6a200d6a5e585b`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:51.061798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bf6ec408-8852-45e2-bdcd-32715e37690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:51.065240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 924/1866] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:51.138564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 943/1867] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:51.143350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:51.144823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:51.211474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d773c-f67c-45db-a2f2-381285b425f6 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:51.272966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b7139-c289-4ca8-bd3e-9daa9ea5fed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:51.272966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b7139-c289-4ca8-bd3e-9daa9ea5fed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.272966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b7139-c289-4ca8-bd3e-9daa9ea5fed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.272966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b7139-c289-4ca8-bd3e-9daa9ea5fed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.273335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b7139-c289-4ca8-bd3e-9daa9ea5fed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:51.273335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b7139-c289-4ca8-bd3e-9daa9ea5fed8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:51.365699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 925/1868] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:51 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:51.369535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ec408-8852-45e2-bdcd-32715e37690c None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:51.381341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ec408-8852-45e2-bdcd-32715e37690c None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:51.444701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29b201-ea74-4b9a-a547-cccec32b506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:51.445419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29b201-ea74-4b9a-a547-cccec32b506c admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.445704 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29b201-ea74-4b9a-a547-cccec32b506c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.445983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29b201-ea74-4b9a-a547-cccec32b506c admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.447587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29b201-ea74-4b9a-a547-cccec32b506c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:51.449525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29b201-ea74-4b9a-a547-cccec32b506c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:51.558118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 944/1869] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:51 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:51.564609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b7139-c289-4ca8-bd3e-9daa9ea5fed8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:51.575003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b7139-c289-4ca8-bd3e-9daa9ea5fed8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:51.579704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00874e-b6ac-416e-bf31-165c83d4ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:51.580353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00874e-b6ac-416e-bf31-165c83d4ece3 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.580634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00874e-b6ac-416e-bf31-165c83d4ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.580909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00874e-b6ac-416e-bf31-165c83d4ece3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.581625 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00874e-b6ac-416e-bf31-165c83d4ece3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:51.583251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00874e-b6ac-416e-bf31-165c83d4ece3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:51.593347 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 926/1870] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:51.597551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29b201-ea74-4b9a-a547-cccec32b506c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:51.609140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29b201-ea74-4b9a-a547-cccec32b506c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:51.613981 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462b9b5-bb4d-4d73-b045-c2e594bb0dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:51.615076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462b9b5-bb4d-4d73-b045-c2e594bb0dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.619600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462b9b5-bb4d-4d73-b045-c2e594bb0dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.619600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462b9b5-bb4d-4d73-b045-c2e594bb0dc9 admin admin] PATH_INFO: `/v3/projects/5de78ab6a7a64a53a7e7b1eb86fb9e16/users/552ce1bf09fa47a292a9596d096acf09/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.622330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00874e-b6ac-416e-bf31-165c83d4ece3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:51.624666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ae00874e-b6ac-416e-bf31-165c83d4ece3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:51.632900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462b9b5-bb4d-4d73-b045-c2e594bb0dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de78ab6a7a64a53a7e7b1eb86fb9e16, user_id=552ce1bf09fa47a292a9596d096acf09, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:51.635655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462b9b5-bb4d-4d73-b045-c2e594bb0dc9 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:51.638433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00874e-b6ac-416e-bf31-165c83d4ece3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:51.647525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:51.648465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.651315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.651315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] PATH_INFO: `/v3/projects/1913b74800934bffbf10883aa89aee0b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.651315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1913b74800934bffbf10883aa89aee0b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:51.652397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:51.715161 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 945/1871] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:51 2022] PUT /identity/v3/projects/5de78ab6a7a64a53a7e7b1eb86fb9e16/users/552ce1bf09fa47a292a9596d096acf09/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:51.719072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462b9b5-bb4d-4d73-b045-c2e594bb0dc9 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:51.777990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462b9b5-bb4d-4d73-b045-c2e594bb0dc9 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:51.779575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1913b74800934bffbf10883aa89aee0b', 'request_id': 'req-2950343f-0a9b-4532-8a16-c462597eb700'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:51.785830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1913b74800934bffbf10883aa89aee0b', 'request_id': 'req-2950343f-0a9b-4532-8a16-c462597eb700'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:51.792013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1913b74800934bffbf10883aa89aee0b', 'request_id': 'req-2950343f-0a9b-4532-8a16-c462597eb700'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:51.834596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910afc-4c6e-4095-9cf7-7bfb67673eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:51.835489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910afc-4c6e-4095-9cf7-7bfb67673eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.835938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910afc-4c6e-4095-9cf7-7bfb67673eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.836355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910afc-4c6e-4095-9cf7-7bfb67673eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.837281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7910afc-4c6e-4095-9cf7-7bfb67673eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:51.838994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7910afc-4c6e-4095-9cf7-7bfb67673eb1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:51.848999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 946/1872] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:15:51.853057 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910afc-4c6e-4095-9cf7-7bfb67673eb1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:51.862886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910afc-4c6e-4095-9cf7-7bfb67673eb1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:51.868223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75828735-9a60-4ad5-a7c8-d148ebed33de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:51.869091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828735-9a60-4ad5-a7c8-d148ebed33de admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.869363 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828735-9a60-4ad5-a7c8-d148ebed33de admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.869634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828735-9a60-4ad5-a7c8-d148ebed33de admin admin] PATH_INFO: `/v3/projects/5de78ab6a7a64a53a7e7b1eb86fb9e16/users/552ce1bf09fa47a292a9596d096acf09/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.871292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] The token cache is being invalidate because project 1913b74800934bffbf10883aa89aee0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:51.871733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75828735-9a60-4ad5-a7c8-d148ebed33de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de78ab6a7a64a53a7e7b1eb86fb9e16, user_id=552ce1bf09fa47a292a9596d096acf09, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:51.871833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:51.877061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:51.877061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 927/1873] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:51 2022] DELETE /identity/v3/projects/1913b74800934bffbf10883aa89aee0b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:51.877254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75828735-9a60-4ad5-a7c8-d148ebed33de admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:51.879680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:51.881700 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:51.888081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 947/1874] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:51 2022] PUT /identity/v3/projects/5de78ab6a7a64a53a7e7b1eb86fb9e16/users/552ce1bf09fa47a292a9596d096acf09/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:51.895775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950343f-0a9b-4532-8a16-c462597eb700 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:51.898182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2746c7-4f0f-4143-b3ae-9125de634f82 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.898474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2746c7-4f0f-4143-b3ae-9125de634f82 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.898776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2746c7-4f0f-4143-b3ae-9125de634f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.944822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9f2746c7-4f0f-4143-b3ae-9125de634f82 None None] MFA Rules not processed for user `552ce1bf09fa47a292a9596d096acf09`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:51.946551 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9f2746c7-4f0f-4143-b3ae-9125de634f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:51.985611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:51.986535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:51.986811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:51.987081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] PATH_INFO: `/v3/users/c82a181335834ba6916b6defa63125d9` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:51.988469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82a181335834ba6916b6defa63125d9)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:51.990236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:52.018450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 948/1875] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:52.028950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2746c7-4f0f-4143-b3ae-9125de634f82 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:52.030822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9f2746c7-4f0f-4143-b3ae-9125de634f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:52.088448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2746c7-4f0f-4143-b3ae-9125de634f82 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:52.092894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f07a3-691e-49e7-a309-029c149e55e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:52.093531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f07a3-691e-49e7-a309-029c149e55e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:52.093807 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f07a3-691e-49e7-a309-029c149e55e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:52.094114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f07a3-691e-49e7-a309-029c149e55e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:52.095889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-952f07a3-691e-49e7-a309-029c149e55e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:52.157303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f07a3-691e-49e7-a309-029c149e55e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:52.158866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f07a3-691e-49e7-a309-029c149e55e9 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:52.168155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 949/1876] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:15:52.261994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82a181335834ba6916b6defa63125d9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:52.263136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82a181335834ba6916b6defa63125d9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:52.277492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82a181335834ba6916b6defa63125d9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:52.278299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82a181335834ba6916b6defa63125d9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:52.315462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4e66b7e9-a8e7-4bae-ab66-e6ca4fa57edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82a181335834ba6916b6defa63125d9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:52.415153 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 928/1877] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:51 2022] DELETE /identity/v3/users/c82a181335834ba6916b6defa63125d9 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:52.953293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f07a3-691e-49e7-a309-029c149e55e9 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:52.966312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f07a3-691e-49e7-a309-029c149e55e9 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:53.039702 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:53.040668 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:53.041452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:53.041729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] PATH_INFO: `/v3/projects/1fdf90fc794448dd995ba4b799ab6346` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:53.042961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdf90fc794448dd995ba4b799ab6346)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:53.044859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:53.224350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdf90fc794448dd995ba4b799ab6346', 'request_id': 'req-7ab2fd74-383d-4b3e-913e-280ac1c8591f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:53.310767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdf90fc794448dd995ba4b799ab6346', 'request_id': 'req-7ab2fd74-383d-4b3e-913e-280ac1c8591f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:53.318387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdf90fc794448dd995ba4b799ab6346', 'request_id': 'req-7ab2fd74-383d-4b3e-913e-280ac1c8591f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:53.331192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] The token cache is being invalidate because project 1fdf90fc794448dd995ba4b799ab6346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:53.331573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:53.332332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7ab2fd74-383d-4b3e-913e-280ac1c8591f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:53.334112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 950/1878] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:52 2022] DELETE /identity/v3/projects/1fdf90fc794448dd995ba4b799ab6346 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:53.339990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca579-3328-432f-bcc3-821d5ca1eaf4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:53.340505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca579-3328-432f-bcc3-821d5ca1eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:53.340832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca579-3328-432f-bcc3-821d5ca1eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:53.362219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fd1ca579-3328-432f-bcc3-821d5ca1eaf4 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:53.363426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fd1ca579-3328-432f-bcc3-821d5ca1eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:53.458896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 929/1879] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:15:53.470095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4fc4-aea5-418c-8a3b-cd0936e5cfd9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:53.470739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4fc4-aea5-418c-8a3b-cd0936e5cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:53.471026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4fc4-aea5-418c-8a3b-cd0936e5cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:53.494622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-52bc4fc4-aea5-418c-8a3b-cd0936e5cfd9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:53.496266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-52bc4fc4-aea5-418c-8a3b-cd0936e5cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:53.509029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 951/1880] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:53.510874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca579-3328-432f-bcc3-821d5ca1eaf4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:53.522223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca579-3328-432f-bcc3-821d5ca1eaf4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:53.528498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ea0cd-a6e8-44cd-ab38-710f8f139fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:53.529194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea0cd-a6e8-44cd-ab38-710f8f139fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:53.529476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea0cd-a6e8-44cd-ab38-710f8f139fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:53.530991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea0cd-a6e8-44cd-ab38-710f8f139fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:53.534763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ea0cd-a6e8-44cd-ab38-710f8f139fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:53.534763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ea0cd-a6e8-44cd-ab38-710f8f139fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:53.535016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ea0cd-a6e8-44cd-ab38-710f8f139fcd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:53.563299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 930/1881] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:15:53.570518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc4fc4-aea5-418c-8a3b-cd0936e5cfd9 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:53.585224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc4fc4-aea5-418c-8a3b-cd0936e5cfd9 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:53.590484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73075c2f-be87-412e-9948-0595680c6679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:53.591719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73075c2f-be87-412e-9948-0595680c6679 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:53.592108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73075c2f-be87-412e-9948-0595680c6679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:53.592995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73075c2f-be87-412e-9948-0595680c6679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:53.593762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73075c2f-be87-412e-9948-0595680c6679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:53.596084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73075c2f-be87-412e-9948-0595680c6679 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:53.742108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 952/1882] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:53 2022] POST /identity/v3/projects => generated 401 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:53.742392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ea0cd-a6e8-44cd-ab38-710f8f139fcd admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:53.765522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ea0cd-a6e8-44cd-ab38-710f8f139fcd admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:53.883115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb674ed-1f87-4cca-b9d8-d9533c82b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:53.889771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb674ed-1f87-4cca-b9d8-d9533c82b283 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:53.889771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb674ed-1f87-4cca-b9d8-d9533c82b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:53.889771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb674ed-1f87-4cca-b9d8-d9533c82b283 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:53.889771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb674ed-1f87-4cca-b9d8-d9533c82b283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:53.889771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb674ed-1f87-4cca-b9d8-d9533c82b283 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:53.996891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 931/1883] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:53 2022] POST /identity/v3/users => generated 301 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:54.009510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73075c2f-be87-412e-9948-0595680c6679 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:54.024417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73075c2f-be87-412e-9948-0595680c6679 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:54.033174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c6705-87f3-41b5-a52a-e86bab9582dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:54.034168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c6705-87f3-41b5-a52a-e86bab9582dc admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.034628 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c6705-87f3-41b5-a52a-e86bab9582dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.035140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c6705-87f3-41b5-a52a-e86bab9582dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.036108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c6705-87f3-41b5-a52a-e86bab9582dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:54.039164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c6705-87f3-41b5-a52a-e86bab9582dc admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:54.054955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 953/1884] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:54.059633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb674ed-1f87-4cca-b9d8-d9533c82b283 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:54.073764 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb674ed-1f87-4cca-b9d8-d9533c82b283 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:54.102513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77743d18-3436-4d81-a4db-6087a064c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:54.103120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77743d18-3436-4d81-a4db-6087a064c834 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.103408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77743d18-3436-4d81-a4db-6087a064c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.103707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77743d18-3436-4d81-a4db-6087a064c834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.104444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77743d18-3436-4d81-a4db-6087a064c834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:54.106089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77743d18-3436-4d81-a4db-6087a064c834 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:54.119560 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 932/1885] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:54.124685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c6705-87f3-41b5-a52a-e86bab9582dc admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:54.134708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c6705-87f3-41b5-a52a-e86bab9582dc admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:54.139670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587fb0f-f115-4701-8b37-52b2e27d544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:54.140581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587fb0f-f115-4701-8b37-52b2e27d544a admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.140934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587fb0f-f115-4701-8b37-52b2e27d544a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.141237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587fb0f-f115-4701-8b37-52b2e27d544a admin admin] PATH_INFO: `/v3/projects/7e3b89bf42c2413fb175f678b9f9f394/users/560ec1c436334d53879fc2830a40b168/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.156051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587fb0f-f115-4701-8b37-52b2e27d544a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3b89bf42c2413fb175f678b9f9f394, user_id=560ec1c436334d53879fc2830a40b168, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:54.158764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587fb0f-f115-4701-8b37-52b2e27d544a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:54.328380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 954/1886] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:54 2022] PUT /identity/v3/projects/7e3b89bf42c2413fb175f678b9f9f394/users/560ec1c436334d53879fc2830a40b168/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:54.344981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5d82-7edc-4e61-8633-94319dee988b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.345442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5d82-7edc-4e61-8633-94319dee988b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.345571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5d82-7edc-4e61-8633-94319dee988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.386010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-41ad5d82-7edc-4e61-8633-94319dee988b None None] MFA Rules not processed for user `560ec1c436334d53879fc2830a40b168`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:54.387265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-41ad5d82-7edc-4e61-8633-94319dee988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:54.451365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 933/1887] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:54.455903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587fb0f-f115-4701-8b37-52b2e27d544a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:54.518047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587fb0f-f115-4701-8b37-52b2e27d544a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:54.522885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecae10-f86e-42b3-981f-2ee0500a84f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:54.523580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecae10-f86e-42b3-981f-2ee0500a84f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.523859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecae10-f86e-42b3-981f-2ee0500a84f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.524130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecae10-f86e-42b3-981f-2ee0500a84f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.524853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecae10-f86e-42b3-981f-2ee0500a84f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:54.526820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecae10-f86e-42b3-981f-2ee0500a84f1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:54.570249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5d82-7edc-4e61-8633-94319dee988b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:54.572160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-41ad5d82-7edc-4e61-8633-94319dee988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:54.587459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5d82-7edc-4e61-8633-94319dee988b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:54.592937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:54.593805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.594109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.594384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] PATH_INFO: `/v3/users/24494e8d530e43989c668fdd613745eb` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.595692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] RBAC: Authorizing `identity:delete_user(user_id=24494e8d530e43989c668fdd613745eb)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:54.597580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:54.673486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 955/1888] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:54 2022] POST /identity/v3/projects => generated 401 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:54.677081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecae10-f86e-42b3-981f-2ee0500a84f1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:54.756950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecae10-f86e-42b3-981f-2ee0500a84f1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:54.761936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194709-5269-44d0-bdc8-22eb463681cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:54.762653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194709-5269-44d0-bdc8-22eb463681cd admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.762943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194709-5269-44d0-bdc8-22eb463681cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.763648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8194709-5269-44d0-bdc8-22eb463681cd admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.764671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8194709-5269-44d0-bdc8-22eb463681cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:54.766713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8194709-5269-44d0-bdc8-22eb463681cd admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:54.806186 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24494e8d530e43989c668fdd613745eb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:54.806457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24494e8d530e43989c668fdd613745eb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:54.819197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24494e8d530e43989c668fdd613745eb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:54.820095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24494e8d530e43989c668fdd613745eb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:54.828771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4be0348-284b-41ea-ba3e-d87b7217197e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24494e8d530e43989c668fdd613745eb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:54.832137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 956/1889] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:54 2022] POST /identity/v3/users => generated 307 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:15:54.838695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194709-5269-44d0-bdc8-22eb463681cd admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:54.840777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f8194709-5269-44d0-bdc8-22eb463681cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:54.853576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8194709-5269-44d0-bdc8-22eb463681cd admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:54.858407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c5503-ffbd-4498-acc3-61da92e2fa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:54.859063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c5503-ffbd-4498-acc3-61da92e2fa87 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.859342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c5503-ffbd-4498-acc3-61da92e2fa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.859614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c5503-ffbd-4498-acc3-61da92e2fa87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.860366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c5503-ffbd-4498-acc3-61da92e2fa87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:54.862079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c5503-ffbd-4498-acc3-61da92e2fa87 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:54.872204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 957/1890] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:15:54.878955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c5503-ffbd-4498-acc3-61da92e2fa87 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:54.888576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c5503-ffbd-4498-acc3-61da92e2fa87 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:54.893730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbf1b-b625-4439-86ad-7f40d4802d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:54.894580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbf1b-b625-4439-86ad-7f40d4802d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.894861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbf1b-b625-4439-86ad-7f40d4802d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.895127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dbf1b-b625-4439-86ad-7f40d4802d25 admin admin] PATH_INFO: `/v3/projects/83cd4701636647adbf26bad2818a3fec/users/f51c8412b08243f8a069b3bf5fcf0bc4/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.905777 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 934/1891] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:54 2022] DELETE /identity/v3/users/24494e8d530e43989c668fdd613745eb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:54.909896 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dbf1b-b625-4439-86ad-7f40d4802d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cd4701636647adbf26bad2818a3fec, user_id=f51c8412b08243f8a069b3bf5fcf0bc4, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:54.910613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66493376-b1b5-42ef-aebc-e986634a944c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:54.911007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66493376-b1b5-42ef-aebc-e986634a944c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:54.911298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66493376-b1b5-42ef-aebc-e986634a944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:54.912871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dbf1b-b625-4439-86ad-7f40d4802d25 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:54.928377 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-66493376-b1b5-42ef-aebc-e986634a944c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:54.929583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-66493376-b1b5-42ef-aebc-e986634a944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:54.991275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 958/1892] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:54 2022] PUT /identity/v3/projects/83cd4701636647adbf26bad2818a3fec/users/f51c8412b08243f8a069b3bf5fcf0bc4/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:55.004285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbf1b-b625-4439-86ad-7f40d4802d25 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:55.006233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 935/1893] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:55.018664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66493376-b1b5-42ef-aebc-e986634a944c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:55.021011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-66493376-b1b5-42ef-aebc-e986634a944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:55.096150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66493376-b1b5-42ef-aebc-e986634a944c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:55.104390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dbf1b-b625-4439-86ad-7f40d4802d25 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:55.109687 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113111-ddbe-4bd6-87c6-24a39a6030d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:55.110631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113111-ddbe-4bd6-87c6-24a39a6030d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:55.111051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113111-ddbe-4bd6-87c6-24a39a6030d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:55.111414 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113111-ddbe-4bd6-87c6-24a39a6030d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:55.112225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24113111-ddbe-4bd6-87c6-24a39a6030d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:55.113911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24113111-ddbe-4bd6-87c6-24a39a6030d5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:55.130357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 959/1894] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:15:55.131499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113111-ddbe-4bd6-87c6-24a39a6030d5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:55.145055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113111-ddbe-4bd6-87c6-24a39a6030d5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:55.149390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ae122-288c-4e90-84c6-ef81e4d5f935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:55.150041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ae122-288c-4e90-84c6-ef81e4d5f935 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:55.151232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ae122-288c-4e90-84c6-ef81e4d5f935 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:55.151232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ae122-288c-4e90-84c6-ef81e4d5f935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:55.152160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c9205-c694-4337-83a5-c8535a75a3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:55.153263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c9205-c694-4337-83a5-c8535a75a3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:55.153930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c9205-c694-4337-83a5-c8535a75a3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:55.154591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c9205-c694-4337-83a5-c8535a75a3e5 admin admin] PATH_INFO: `/v3/projects/83cd4701636647adbf26bad2818a3fec/users/f51c8412b08243f8a069b3bf5fcf0bc4/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:55.156909 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c9205-c694-4337-83a5-c8535a75a3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cd4701636647adbf26bad2818a3fec, user_id=f51c8412b08243f8a069b3bf5fcf0bc4, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:55.160208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c9205-c694-4337-83a5-c8535a75a3e5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:55.163595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ae122-288c-4e90-84c6-ef81e4d5f935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:55.165276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ae122-288c-4e90-84c6-ef81e4d5f935 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:55.171722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 960/1895] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:55 2022] PUT /identity/v3/projects/83cd4701636647adbf26bad2818a3fec/users/f51c8412b08243f8a069b3bf5fcf0bc4/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:55.176841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 936/1896] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:55.189889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fd73d-6134-4a97-bbab-d27727c151b0 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:55.190273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fd73d-6134-4a97-bbab-d27727c151b0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:55.192434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fd73d-6134-4a97-bbab-d27727c151b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:55.219800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-4e2fd73d-6134-4a97-bbab-d27727c151b0 None None] MFA Rules not processed for user `f51c8412b08243f8a069b3bf5fcf0bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:55.221009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4e2fd73d-6134-4a97-bbab-d27727c151b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:55.293167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 961/1897] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:55.304893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ae122-288c-4e90-84c6-ef81e4d5f935 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:55.306288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f94ae122-288c-4e90-84c6-ef81e4d5f935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:55.363006 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ae122-288c-4e90-84c6-ef81e4d5f935 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:55.468048 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e349-a075-47be-b06b-9f7e23bcb5b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:55.468749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e349-a075-47be-b06b-9f7e23bcb5b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:55.469029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e349-a075-47be-b06b-9f7e23bcb5b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:55.470243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e349-a075-47be-b06b-9f7e23bcb5b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:55.480384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135e349-a075-47be-b06b-9f7e23bcb5b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:55.482459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135e349-a075-47be-b06b-9f7e23bcb5b0 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:55.492971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 937/1898] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:55.624431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fd73d-6134-4a97-bbab-d27727c151b0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:55.627313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4e2fd73d-6134-4a97-bbab-d27727c151b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:55.701968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fd73d-6134-4a97-bbab-d27727c151b0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:55.706540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:55.707384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:55.708016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:55.708016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] PATH_INFO: `/v3/projects/c282449b6d684b62b5dcf90f4a776178` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:55.709105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c282449b6d684b62b5dcf90f4a776178)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:55.711047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:55.739125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e349-a075-47be-b06b-9f7e23bcb5b0 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:55.746121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f135e349-a075-47be-b06b-9f7e23bcb5b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:55.750954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e349-a075-47be-b06b-9f7e23bcb5b0 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:55.754786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0188b-a71a-4a34-a55c-978c1fdddd64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:55.755501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0188b-a71a-4a34-a55c-978c1fdddd64 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:55.755766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0188b-a71a-4a34-a55c-978c1fdddd64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:55.756044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0188b-a71a-4a34-a55c-978c1fdddd64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:55.757825 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1bd0188b-a71a-4a34-a55c-978c1fdddd64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:55.823400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0188b-a71a-4a34-a55c-978c1fdddd64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:55.826536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0188b-a71a-4a34-a55c-978c1fdddd64 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:55.832525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c282449b6d684b62b5dcf90f4a776178', 'request_id': 'req-908f533b-72dc-4ba8-bf4f-f15c2d643133'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:55.835319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 938/1899] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:15:55.899667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c282449b6d684b62b5dcf90f4a776178', 'request_id': 'req-908f533b-72dc-4ba8-bf4f-f15c2d643133'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:55.906593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c282449b6d684b62b5dcf90f4a776178', 'request_id': 'req-908f533b-72dc-4ba8-bf4f-f15c2d643133'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:55.922263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] The token cache is being invalidate because project c282449b6d684b62b5dcf90f4a776178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:55.922549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:55.923329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:55.924906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 962/1900] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:55 2022] DELETE /identity/v3/projects/c282449b6d684b62b5dcf90f4a776178 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:55.929049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0188b-a71a-4a34-a55c-978c1fdddd64 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:55.941147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0188b-a71a-4a34-a55c-978c1fdddd64 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:56.007476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:56.008348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:56.008626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:56.008901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] PATH_INFO: `/v3/users/81595384f6ff4b479781d2559c601654` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:56.010110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81595384f6ff4b479781d2559c601654)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:56.012018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:56.157118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81595384f6ff4b479781d2559c601654'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.157677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81595384f6ff4b479781d2559c601654'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.169266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81595384f6ff4b479781d2559c601654'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.169926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81595384f6ff4b479781d2559c601654'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.176893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0a1252bd-ff7c-4e5f-ae9f-95c14fa18eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81595384f6ff4b479781d2559c601654'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.246263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 939/1901] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:15:55 2022] DELETE /identity/v3/users/81595384f6ff4b479781d2559c601654 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:15:56.673657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:56.675163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:56.688183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f533b-72dc-4ba8-bf4f-f15c2d643133 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:56.744552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:56.745403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:56.745680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:56.745948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] PATH_INFO: `/v3/projects/4b8ff636c0824f359d4a617b77ce0403` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:56.747196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8ff636c0824f359d4a617b77ce0403)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:56.749150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:56.845559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8ff636c0824f359d4a617b77ce0403', 'request_id': 'req-ae9a165c-0d6b-407d-b9b9-0ce87e594033'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.903092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8ff636c0824f359d4a617b77ce0403', 'request_id': 'req-ae9a165c-0d6b-407d-b9b9-0ce87e594033'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.909030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8ff636c0824f359d4a617b77ce0403', 'request_id': 'req-ae9a165c-0d6b-407d-b9b9-0ce87e594033'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.923938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] The token cache is being invalidate because project 4b8ff636c0824f359d4a617b77ce0403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:15:56.924252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.924923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ae9a165c-0d6b-407d-b9b9-0ce87e594033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:15:56.926595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 963/1902] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:15:56 2022] DELETE /identity/v3/projects/4b8ff636c0824f359d4a617b77ce0403 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:56.932382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532501ae-7303-4d13-bd41-254e36a17f5c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:56.932822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532501ae-7303-4d13-bd41-254e36a17f5c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:56.932997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532501ae-7303-4d13-bd41-254e36a17f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:56.950829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-532501ae-7303-4d13-bd41-254e36a17f5c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:56.952536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-532501ae-7303-4d13-bd41-254e36a17f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:57.011475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 940/1903] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:57.019809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2575aa1-ac35-4a2f-94e0-a561ca9945d0 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.020101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2575aa1-ac35-4a2f-94e0-a561ca9945d0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.020379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2575aa1-ac35-4a2f-94e0-a561ca9945d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.039102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a2575aa1-ac35-4a2f-94e0-a561ca9945d0 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:57.040305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a2575aa1-ac35-4a2f-94e0-a561ca9945d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:57.048418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 964/1904] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:57.052402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532501ae-7303-4d13-bd41-254e36a17f5c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:57.061754 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532501ae-7303-4d13-bd41-254e36a17f5c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:57.066373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230abc4-add0-4a6d-af7d-8474dab22147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:57.075429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230abc4-add0-4a6d-af7d-8474dab22147 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.075429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230abc4-add0-4a6d-af7d-8474dab22147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.075429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230abc4-add0-4a6d-af7d-8474dab22147 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.075429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230abc4-add0-4a6d-af7d-8474dab22147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:15:57.075429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230abc4-add0-4a6d-af7d-8474dab22147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:57.075429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230abc4-add0-4a6d-af7d-8474dab22147 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:57.083107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 941/1905] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:15:57.086931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2575aa1-ac35-4a2f-94e0-a561ca9945d0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:57.096573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2575aa1-ac35-4a2f-94e0-a561ca9945d0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:57.101403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa532e-7a34-473e-aff6-da8f3215dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:57.104155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa532e-7a34-473e-aff6-da8f3215dcba admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.104155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa532e-7a34-473e-aff6-da8f3215dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.104155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa532e-7a34-473e-aff6-da8f3215dcba admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.104155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa532e-7a34-473e-aff6-da8f3215dcba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:57.105189 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa532e-7a34-473e-aff6-da8f3215dcba admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:57.255614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 965/1906] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:57 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:57.259632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230abc4-add0-4a6d-af7d-8474dab22147 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:57.270231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230abc4-add0-4a6d-af7d-8474dab22147 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:57.323987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bfcfe-655f-4666-af3c-db35d41467d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:57.324778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bfcfe-655f-4666-af3c-db35d41467d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.325064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bfcfe-655f-4666-af3c-db35d41467d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.325341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bfcfe-655f-4666-af3c-db35d41467d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.326040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bfcfe-655f-4666-af3c-db35d41467d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:57.328648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bfcfe-655f-4666-af3c-db35d41467d6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:57.443289 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 942/1907] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:57 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:57.453885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa532e-7a34-473e-aff6-da8f3215dcba admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:57.459418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa532e-7a34-473e-aff6-da8f3215dcba admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:57.464644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6931f-55c9-48a5-a3c7-5be5019dcd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:57.465381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6931f-55c9-48a5-a3c7-5be5019dcd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.465745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6931f-55c9-48a5-a3c7-5be5019dcd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.466125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6931f-55c9-48a5-a3c7-5be5019dcd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.466954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6931f-55c9-48a5-a3c7-5be5019dcd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:57.468755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6931f-55c9-48a5-a3c7-5be5019dcd03 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:57.480744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 966/1908] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:15:57.484794 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bfcfe-655f-4666-af3c-db35d41467d6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:57.494774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bfcfe-655f-4666-af3c-db35d41467d6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:57.499963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3aae64-b0d1-4d54-a3f9-8848d305a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:57.500559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aae64-b0d1-4d54-a3f9-8848d305a1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.500835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aae64-b0d1-4d54-a3f9-8848d305a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.501106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aae64-b0d1-4d54-a3f9-8848d305a1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.501822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3aae64-b0d1-4d54-a3f9-8848d305a1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:57.503432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3aae64-b0d1-4d54-a3f9-8848d305a1d4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:57.513039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 943/1909] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:57.517624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6931f-55c9-48a5-a3c7-5be5019dcd03 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:57.527220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6931f-55c9-48a5-a3c7-5be5019dcd03 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:57.531783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f33b0-7598-4476-8ee0-1edf3c3feb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:57.532643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f33b0-7598-4476-8ee0-1edf3c3feb55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.532923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f33b0-7598-4476-8ee0-1edf3c3feb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.533197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f33b0-7598-4476-8ee0-1edf3c3feb55 admin admin] PATH_INFO: `/v3/projects/d2bc11c884ec4adb8281baffcfc6701f/users/d81a3fbdc1bb42ea950759cff609ad3c/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.547415 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f33b0-7598-4476-8ee0-1edf3c3feb55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bc11c884ec4adb8281baffcfc6701f, user_id=d81a3fbdc1bb42ea950759cff609ad3c, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:57.550032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f33b0-7598-4476-8ee0-1edf3c3feb55 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:57.625667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 967/1910] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:57 2022] PUT /identity/v3/projects/d2bc11c884ec4adb8281baffcfc6701f/users/d81a3fbdc1bb42ea950759cff609ad3c/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:57.636784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0acdbb-8881-43a7-adc9-b16c299e0158 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.637078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0acdbb-8881-43a7-adc9-b16c299e0158 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.637359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0acdbb-8881-43a7-adc9-b16c299e0158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.667718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5a0acdbb-8881-43a7-adc9-b16c299e0158 None None] MFA Rules not processed for user `d81a3fbdc1bb42ea950759cff609ad3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:57.668914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5a0acdbb-8881-43a7-adc9-b16c299e0158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:57.734319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 944/1911] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:57.739140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f33b0-7598-4476-8ee0-1edf3c3feb55 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:57.800147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f33b0-7598-4476-8ee0-1edf3c3feb55 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:57.804857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc48ec-10e3-4e49-8bbb-0857aa60382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:57.805509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc48ec-10e3-4e49-8bbb-0857aa60382f admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.805785 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc48ec-10e3-4e49-8bbb-0857aa60382f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.806086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc48ec-10e3-4e49-8bbb-0857aa60382f admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.806778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc48ec-10e3-4e49-8bbb-0857aa60382f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:57.808695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc48ec-10e3-4e49-8bbb-0857aa60382f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:57.888440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 968/1912] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:15:57 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:57.892599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0acdbb-8881-43a7-adc9-b16c299e0158 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:57.903237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0acdbb-8881-43a7-adc9-b16c299e0158 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:57.958300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f1e31-57a9-446a-a455-bfaed278ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:57.959101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f1e31-57a9-446a-a455-bfaed278ce3d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:57.959295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f1e31-57a9-446a-a455-bfaed278ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:57.959571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f1e31-57a9-446a-a455-bfaed278ce3d admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:57.960272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f1e31-57a9-446a-a455-bfaed278ce3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:57.962388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f1e31-57a9-446a-a455-bfaed278ce3d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:58.088326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 945/1913] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:15:57 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:15:58.093053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc48ec-10e3-4e49-8bbb-0857aa60382f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:58.103138 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc48ec-10e3-4e49-8bbb-0857aa60382f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:58.108362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dbfaf-ed19-49e0-97d5-edd339b5305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:58.109053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dbfaf-ed19-49e0-97d5-edd339b5305d admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:58.109334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dbfaf-ed19-49e0-97d5-edd339b5305d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:58.109605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dbfaf-ed19-49e0-97d5-edd339b5305d admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:58.110366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dbfaf-ed19-49e0-97d5-edd339b5305d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:58.111967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dbfaf-ed19-49e0-97d5-edd339b5305d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:58.126286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 969/1914] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:58.127522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f1e31-57a9-446a-a455-bfaed278ce3d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:58.137531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f1e31-57a9-446a-a455-bfaed278ce3d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:58.143791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e07e90-a767-4e97-9668-8ee91651fde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:58.145004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e07e90-a767-4e97-9668-8ee91651fde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:58.145532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e07e90-a767-4e97-9668-8ee91651fde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:58.146205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e07e90-a767-4e97-9668-8ee91651fde0 admin admin] PATH_INFO: `/v3/projects/ab4af0b333b348f5877011b6b5abb19a/users/184ab4b90276403fb4da049a034c6d40/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:58.163994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e07e90-a767-4e97-9668-8ee91651fde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4af0b333b348f5877011b6b5abb19a, user_id=184ab4b90276403fb4da049a034c6d40, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:58.166684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e07e90-a767-4e97-9668-8ee91651fde0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:58.281490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 946/1915] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:58 2022] PUT /identity/v3/projects/ab4af0b333b348f5877011b6b5abb19a/users/184ab4b90276403fb4da049a034c6d40/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:58.285631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dbfaf-ed19-49e0-97d5-edd339b5305d admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:58.295879 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dbfaf-ed19-49e0-97d5-edd339b5305d admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:58.351443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552a984-9886-4d15-8393-1671177465cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:58.352033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552a984-9886-4d15-8393-1671177465cd admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:58.352309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552a984-9886-4d15-8393-1671177465cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:58.352578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552a984-9886-4d15-8393-1671177465cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:58.353297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552a984-9886-4d15-8393-1671177465cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:58.354972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552a984-9886-4d15-8393-1671177465cd admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:58.364314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 970/1916] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:15:58.368539 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e07e90-a767-4e97-9668-8ee91651fde0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:58.378969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e07e90-a767-4e97-9668-8ee91651fde0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:58.383660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0345-8fdf-472a-90e2-8d99e4ecfeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:58.384526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0345-8fdf-472a-90e2-8d99e4ecfeac admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:58.384806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0345-8fdf-472a-90e2-8d99e4ecfeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:58.385078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0345-8fdf-472a-90e2-8d99e4ecfeac admin admin] PATH_INFO: `/v3/projects/ab4af0b333b348f5877011b6b5abb19a/users/184ab4b90276403fb4da049a034c6d40/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:58.387142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc0345-8fdf-472a-90e2-8d99e4ecfeac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4af0b333b348f5877011b6b5abb19a, user_id=184ab4b90276403fb4da049a034c6d40, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:58.390558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc0345-8fdf-472a-90e2-8d99e4ecfeac admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:58.401047 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 947/1917] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:15:58 2022] PUT /identity/v3/projects/ab4af0b333b348f5877011b6b5abb19a/users/184ab4b90276403fb4da049a034c6d40/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:15:58.412307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549b5db-5ce8-4776-a7ef-db55292246d1 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:58.412603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549b5db-5ce8-4776-a7ef-db55292246d1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:58.412941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549b5db-5ce8-4776-a7ef-db55292246d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:58.439140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-5549b5db-5ce8-4776-a7ef-db55292246d1 None None] MFA Rules not processed for user `184ab4b90276403fb4da049a034c6d40`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:15:58.440392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5549b5db-5ce8-4776-a7ef-db55292246d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:58.512966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 971/1918] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:15:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:15:58.524557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0345-8fdf-472a-90e2-8d99e4ecfeac admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:58.526845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-95dc0345-8fdf-472a-90e2-8d99e4ecfeac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:58.596629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0345-8fdf-472a-90e2-8d99e4ecfeac admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:58.601205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98923b92-0382-432b-b54b-335be8f7a227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:58.601919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98923b92-0382-432b-b54b-335be8f7a227 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:58.602170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98923b92-0382-432b-b54b-335be8f7a227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:58.602441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98923b92-0382-432b-b54b-335be8f7a227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:58.613559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98923b92-0382-432b-b54b-335be8f7a227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:58.615244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98923b92-0382-432b-b54b-335be8f7a227 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:58.626944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 948/1919] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:15:59.427961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549b5db-5ce8-4776-a7ef-db55292246d1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:15:59.429656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5549b5db-5ce8-4776-a7ef-db55292246d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:59.458416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549b5db-5ce8-4776-a7ef-db55292246d1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:15:59.464121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:15:59.465456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:15:59.465806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:15:59.466247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:15:59.470343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:15:59.568880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:15:59.571340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:15:59.582069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 972/1920] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:15:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:00.772506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98923b92-0382-432b-b54b-335be8f7a227 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:00.835695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98923b92-0382-432b-b54b-335be8f7a227 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:00.840162 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:00.841085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:00.841379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:00.842233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] PATH_INFO: `/v3/users/d81a3fbdc1bb42ea950759cff609ad3c` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:00.843438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81a3fbdc1bb42ea950759cff609ad3c)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:00.845346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:00.952899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:00.954381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:00.970182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222c938-8823-44d5-af10-7d24a809ee3b service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:00.974830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:00.975693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:00.975972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:00.976243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] PATH_INFO: `/v3/users/2621da2724654fbbb4b693c483584310` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:00.977599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2621da2724654fbbb4b693c483584310)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:00.979678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:01.021665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81a3fbdc1bb42ea950759cff609ad3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.022337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81a3fbdc1bb42ea950759cff609ad3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.033909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81a3fbdc1bb42ea950759cff609ad3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.034684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81a3fbdc1bb42ea950759cff609ad3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.041864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-046bb682-b4c0-4e6d-a98d-de0bf210316d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81a3fbdc1bb42ea950759cff609ad3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.148522 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 949/1921] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:00 2022] DELETE /identity/v3/users/d81a3fbdc1bb42ea950759cff609ad3c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:01.152924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14239-5826-4745-9047-bc780fce5493 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:01.153214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14239-5826-4745-9047-bc780fce5493 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:01.153494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14239-5826-4745-9047-bc780fce5493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:01.169768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-22b14239-5826-4745-9047-bc780fce5493 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:01.170992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-22b14239-5826-4745-9047-bc780fce5493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:01.229885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 950/1922] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:01.231023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2621da2724654fbbb4b693c483584310'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.231661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2621da2724654fbbb4b693c483584310'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.232262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2621da2724654fbbb4b693c483584310'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.241345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b14239-5826-4745-9047-bc780fce5493 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:01.242843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-22b14239-5826-4745-9047-bc780fce5493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:01.245040 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2621da2724654fbbb4b693c483584310'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.252876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-edd390f5-1c43-49ac-85a4-b3c88647a4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2621da2724654fbbb4b693c483584310'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:01.301783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b14239-5826-4745-9047-bc780fce5493 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:01.305367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:01.306009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:01.306323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:01.306596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:01.308362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:01.320157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:01.321837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:01.342796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 973/1923] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:00 2022] DELETE /identity/v3/users/2621da2724654fbbb4b693c483584310 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:01.342919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 951/1924] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:16:01.343032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539fe49-268e-4339-a18c-bfdfea7fb95a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:01.343032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539fe49-268e-4339-a18c-bfdfea7fb95a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:01.343032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539fe49-268e-4339-a18c-bfdfea7fb95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:01.356207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f539fe49-268e-4339-a18c-bfdfea7fb95a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:01.357469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f539fe49-268e-4339-a18c-bfdfea7fb95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:01.422386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 974/1925] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:01.432306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:01.433803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:01.444521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2782de-ae76-4b81-acf8-3d8c27ea2fc0 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:01.492017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ec9a2-a278-4f33-844d-f7e8971d5066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:01.492664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ec9a2-a278-4f33-844d-f7e8971d5066 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:01.492970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ec9a2-a278-4f33-844d-f7e8971d5066 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:01.493267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ec9a2-a278-4f33-844d-f7e8971d5066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:01.502685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ec9a2-a278-4f33-844d-f7e8971d5066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:01.504227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ec9a2-a278-4f33-844d-f7e8971d5066 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:01.514378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 952/1926] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:16:01.819002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539fe49-268e-4339-a18c-bfdfea7fb95a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:01.821660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f539fe49-268e-4339-a18c-bfdfea7fb95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:01.834411 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539fe49-268e-4339-a18c-bfdfea7fb95a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:01.839139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:01.842308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:01.842308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:01.842308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] PATH_INFO: `/v3/projects/d2bc11c884ec4adb8281baffcfc6701f` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:01.842308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bc11c884ec4adb8281baffcfc6701f)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:01.844274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:01.963969 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bc11c884ec4adb8281baffcfc6701f', 'request_id': 'req-83158913-5a5f-41bd-b107-bc952bb29493'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.021214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ec9a2-a278-4f33-844d-f7e8971d5066 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:02.022664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-172ec9a2-a278-4f33-844d-f7e8971d5066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:02.035852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ec9a2-a278-4f33-844d-f7e8971d5066 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:02.052899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bc11c884ec4adb8281baffcfc6701f', 'request_id': 'req-83158913-5a5f-41bd-b107-bc952bb29493'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.053683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bc11c884ec4adb8281baffcfc6701f', 'request_id': 'req-83158913-5a5f-41bd-b107-bc952bb29493'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.065505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] The token cache is being invalidate because project d2bc11c884ec4adb8281baffcfc6701f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:02.065946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.066616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.068153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 975/1927] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:01 2022] DELETE /identity/v3/projects/d2bc11c884ec4adb8281baffcfc6701f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:02.072342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:02.073723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:02.099372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:02.100243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.100526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.100815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] PATH_INFO: `/v3/projects/9811f9580e1340698b940f81b961111c` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.101997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9811f9580e1340698b940f81b961111c)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:02.104066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:02.155905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83158913-5a5f-41bd-b107-bc952bb29493 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:02.160634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:02.161526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.161801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.162092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] PATH_INFO: `/v3/users/184ab4b90276403fb4da049a034c6d40` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.163284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184ab4b90276403fb4da049a034c6d40)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:02.165187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:02.223770 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9811f9580e1340698b940f81b961111c', 'request_id': 'req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.231024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9811f9580e1340698b940f81b961111c', 'request_id': 'req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.236566 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9811f9580e1340698b940f81b961111c', 'request_id': 'req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.319324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] The token cache is being invalidate because project 9811f9580e1340698b940f81b961111c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:02.319609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.320223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-856da07d-57dc-4a7b-8e7c-2bfcaf8403d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.322120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 953/1928] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:02 2022] DELETE /identity/v3/projects/9811f9580e1340698b940f81b961111c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:02.327226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44126f0-ae75-4874-86f1-903239b5d00c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.327511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44126f0-ae75-4874-86f1-903239b5d00c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.327786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44126f0-ae75-4874-86f1-903239b5d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.345500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f44126f0-ae75-4874-86f1-903239b5d00c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:02.346744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f44126f0-ae75-4874-86f1-903239b5d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:02.353649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184ab4b90276403fb4da049a034c6d40'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.354387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184ab4b90276403fb4da049a034c6d40'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.355228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184ab4b90276403fb4da049a034c6d40'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.369107 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184ab4b90276403fb4da049a034c6d40'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.379917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184ab4b90276403fb4da049a034c6d40'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:02.406938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 954/1929] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:02.414476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdee44-6e89-4325-ade7-b72cbdc0dae2 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.414759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdee44-6e89-4325-ade7-b72cbdc0dae2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.415029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdee44-6e89-4325-ade7-b72cbdc0dae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.432333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5cfdee44-6e89-4325-ade7-b72cbdc0dae2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:02.433513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5cfdee44-6e89-4325-ade7-b72cbdc0dae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:02.442034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 955/1930] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:02.446407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdee44-6e89-4325-ade7-b72cbdc0dae2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:02.455463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 976/1931] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:02 2022] DELETE /identity/v3/users/184ab4b90276403fb4da049a034c6d40 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:02.459685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdee44-6e89-4325-ade7-b72cbdc0dae2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:02.514140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa090-2735-468e-90de-457a804108b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:02.514746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa090-2735-468e-90de-457a804108b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.515027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa090-2735-468e-90de-457a804108b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.515297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa090-2735-468e-90de-457a804108b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.516029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa090-2735-468e-90de-457a804108b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:02.516358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa090-2735-468e-90de-457a804108b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:02.517953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aa090-2735-468e-90de-457a804108b7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:02.531660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 956/1932] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:16:02.541603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:02.546192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa7d30-7844-4ea6-8ee3-393fc31d3d81 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:02.556863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c3d9e-a3ef-4e49-833b-7f8a123995f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:02.557586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c3d9e-a3ef-4e49-833b-7f8a123995f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.557867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c3d9e-a3ef-4e49-833b-7f8a123995f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.558172 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c3d9e-a3ef-4e49-833b-7f8a123995f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.558907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c3d9e-a3ef-4e49-833b-7f8a123995f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:02.561306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c3d9e-a3ef-4e49-833b-7f8a123995f0 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:02.661861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 977/1933] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:02 2022] POST /identity/v3/projects => generated 361 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:02.663052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa090-2735-468e-90de-457a804108b7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:02.673032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa090-2735-468e-90de-457a804108b7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:02.731390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c1a04-4550-43f3-9422-1735a7ff86ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:02.732007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c1a04-4550-43f3-9422-1735a7ff86ee admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.732293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c1a04-4550-43f3-9422-1735a7ff86ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.732571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c1a04-4550-43f3-9422-1735a7ff86ee admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.733274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c1a04-4550-43f3-9422-1735a7ff86ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:02.735293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c1a04-4550-43f3-9422-1735a7ff86ee admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:02.842115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 957/1934] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:02 2022] POST /identity/v3/users => generated 281 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:02.846359 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c3d9e-a3ef-4e49-833b-7f8a123995f0 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:02.856661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c3d9e-a3ef-4e49-833b-7f8a123995f0 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:02.861855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b9bc3-60bd-4e80-b300-6afb37a43484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:02.862549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b9bc3-60bd-4e80-b300-6afb37a43484 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.862831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b9bc3-60bd-4e80-b300-6afb37a43484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.863105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b9bc3-60bd-4e80-b300-6afb37a43484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.863861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b9bc3-60bd-4e80-b300-6afb37a43484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:02.865628 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b9bc3-60bd-4e80-b300-6afb37a43484 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:02.872432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c1a04-4550-43f3-9422-1735a7ff86ee admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:02.874864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ff8c1a04-4550-43f3-9422-1735a7ff86ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:02.883032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 978/1935] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:02.884804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b9bc3-60bd-4e80-b300-6afb37a43484 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:02.894077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c1a04-4550-43f3-9422-1735a7ff86ee admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:02.895576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b9bc3-60bd-4e80-b300-6afb37a43484 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:02.900106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:02.900933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ca020-0614-49bb-b09c-fd29b2cb00af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:02.901070 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.901229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.901501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] PATH_INFO: `/v3/projects/ab4af0b333b348f5877011b6b5abb19a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.901875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca020-0614-49bb-b09c-fd29b2cb00af admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.902257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca020-0614-49bb-b09c-fd29b2cb00af admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.902599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca020-0614-49bb-b09c-fd29b2cb00af admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.902960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4af0b333b348f5877011b6b5abb19a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:02.903505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ca020-0614-49bb-b09c-fd29b2cb00af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:02.904895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:02.905492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ca020-0614-49bb-b09c-fd29b2cb00af admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:02.915725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 979/1936] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:02.920542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ca020-0614-49bb-b09c-fd29b2cb00af admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:02.930267 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ca020-0614-49bb-b09c-fd29b2cb00af admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:02.936045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faced358-242a-4cd6-bed1-ca36ac57cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:02.936925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faced358-242a-4cd6-bed1-ca36ac57cabf admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:02.937205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faced358-242a-4cd6-bed1-ca36ac57cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:02.937481 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faced358-242a-4cd6-bed1-ca36ac57cabf admin admin] PATH_INFO: `/v3/projects/671c7ab3f9a24ab790a27dfb3e04350e/users/53889572cbcc460da11d04676f02b993/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:02.952318 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faced358-242a-4cd6-bed1-ca36ac57cabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=671c7ab3f9a24ab790a27dfb3e04350e, user_id=53889572cbcc460da11d04676f02b993, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:02.956281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faced358-242a-4cd6-bed1-ca36ac57cabf admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.045736 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 980/1937] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:02 2022] PUT /identity/v3/projects/671c7ab3f9a24ab790a27dfb3e04350e/users/53889572cbcc460da11d04676f02b993/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:03.050557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4af0b333b348f5877011b6b5abb19a', 'request_id': 'req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.057672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c3efe-1b99-4072-aeff-16212a54818a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.057961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c3efe-1b99-4072-aeff-16212a54818a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.058305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c3efe-1b99-4072-aeff-16212a54818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.060730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4af0b333b348f5877011b6b5abb19a', 'request_id': 'req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.067316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4af0b333b348f5877011b6b5abb19a', 'request_id': 'req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.087091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-b45c3efe-1b99-4072-aeff-16212a54818a None None] MFA Rules not processed for user `53889572cbcc460da11d04676f02b993`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:03.088351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b45c3efe-1b99-4072-aeff-16212a54818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:03.150740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 981/1938] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:03.184196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c3efe-1b99-4072-aeff-16212a54818a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:03.185622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b45c3efe-1b99-4072-aeff-16212a54818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:03.240134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c3efe-1b99-4072-aeff-16212a54818a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:03.243882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820638b8-8790-4e31-b27b-0453fd6f7a68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:03.244444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820638b8-8790-4e31-b27b-0453fd6f7a68 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.244726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820638b8-8790-4e31-b27b-0453fd6f7a68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.245000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820638b8-8790-4e31-b27b-0453fd6f7a68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.253509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820638b8-8790-4e31-b27b-0453fd6f7a68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:03.254963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820638b8-8790-4e31-b27b-0453fd6f7a68 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.263744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 982/1939] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:16:03.277186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820638b8-8790-4e31-b27b-0453fd6f7a68 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:03.290805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] The token cache is being invalidate because project ab4af0b333b348f5877011b6b5abb19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:03.291094 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.291774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe3c3fa8-c2e5-4f75-94da-5326e0b11d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.293609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 958/1940] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:02 2022] DELETE /identity/v3/projects/ab4af0b333b348f5877011b6b5abb19a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:03.298772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1497-14d4-4c59-b3b7-f58b852a460b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.299085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1497-14d4-4c59-b3b7-f58b852a460b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.299335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1497-14d4-4c59-b3b7-f58b852a460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.316844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8d6c1497-14d4-4c59-b3b7-f58b852a460b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:03.318041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8d6c1497-14d4-4c59-b3b7-f58b852a460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:03.363344 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820638b8-8790-4e31-b27b-0453fd6f7a68 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:03.368183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:03.369133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.369414 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.369735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] PATH_INFO: `/v3/users/53889572cbcc460da11d04676f02b993` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.370993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] RBAC: Authorizing `identity:delete_user(user_id=53889572cbcc460da11d04676f02b993)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:03.373405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.389163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 959/1941] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:03.396942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d9f2d-545e-46f7-999b-c2be86382a8a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.397384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d9f2d-545e-46f7-999b-c2be86382a8a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.397473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d9f2d-545e-46f7-999b-c2be86382a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.416303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4c0d9f2d-545e-46f7-999b-c2be86382a8a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:03.417480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4c0d9f2d-545e-46f7-999b-c2be86382a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:03.426102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 960/1942] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:03.430023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d9f2d-545e-46f7-999b-c2be86382a8a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:03.438839 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d9f2d-545e-46f7-999b-c2be86382a8a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:03.443581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cdf12-df6f-4695-981a-6d699abb063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:03.446580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cdf12-df6f-4695-981a-6d699abb063a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.446580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cdf12-df6f-4695-981a-6d699abb063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.446580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cdf12-df6f-4695-981a-6d699abb063a admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.446580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cdf12-df6f-4695-981a-6d699abb063a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:03.446580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cdf12-df6f-4695-981a-6d699abb063a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:03.447576 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cdf12-df6f-4695-981a-6d699abb063a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.459023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 961/1943] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:16:03.463146 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cdf12-df6f-4695-981a-6d699abb063a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:03.472950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cdf12-df6f-4695-981a-6d699abb063a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:03.477796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75b4c2-fb30-4123-a132-f9425611efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:03.478462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75b4c2-fb30-4123-a132-f9425611efc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.478758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75b4c2-fb30-4123-a132-f9425611efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.479028 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75b4c2-fb30-4123-a132-f9425611efc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.479703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75b4c2-fb30-4123-a132-f9425611efc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:03.481614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75b4c2-fb30-4123-a132-f9425611efc4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.550114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53889572cbcc460da11d04676f02b993'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.550772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53889572cbcc460da11d04676f02b993'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.551382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53889572cbcc460da11d04676f02b993'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.565047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53889572cbcc460da11d04676f02b993'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.573161 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8dd390de-a000-4578-8da1-8397e9f3ddec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53889572cbcc460da11d04676f02b993'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:03.584897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 962/1944] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:03 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:03.588809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75b4c2-fb30-4123-a132-f9425611efc4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:03.590599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fc75b4c2-fb30-4123-a132-f9425611efc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:03.654808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75b4c2-fb30-4123-a132-f9425611efc4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:03.661023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 983/1945] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:03 2022] DELETE /identity/v3/users/53889572cbcc460da11d04676f02b993 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:03.661178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca257842-13f7-4de1-a8ad-4c4180cd3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:03.661178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca257842-13f7-4de1-a8ad-4c4180cd3002 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.661178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca257842-13f7-4de1-a8ad-4c4180cd3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.661178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca257842-13f7-4de1-a8ad-4c4180cd3002 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.662101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca257842-13f7-4de1-a8ad-4c4180cd3002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:03.662587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35529c-6ff5-4e1c-b9b5-62cf3a77dd35 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.662874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35529c-6ff5-4e1c-b9b5-62cf3a77dd35 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.663150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35529c-6ff5-4e1c-b9b5-62cf3a77dd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.664325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca257842-13f7-4de1-a8ad-4c4180cd3002 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.679999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7b35529c-6ff5-4e1c-b9b5-62cf3a77dd35 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:03.681291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7b35529c-6ff5-4e1c-b9b5-62cf3a77dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:03.739774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 984/1946] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:03.749246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 963/1947] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:03 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:03.749681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35529c-6ff5-4e1c-b9b5-62cf3a77dd35 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:03.750665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca257842-13f7-4de1-a8ad-4c4180cd3002 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:03.751038 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7b35529c-6ff5-4e1c-b9b5-62cf3a77dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:03.760428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca257842-13f7-4de1-a8ad-4c4180cd3002 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:03.765562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91874d-7bca-4686-abc5-99b5956a8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:03.766245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91874d-7bca-4686-abc5-99b5956a8184 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.766534 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91874d-7bca-4686-abc5-99b5956a8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.766859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91874d-7bca-4686-abc5-99b5956a8184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.767546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91874d-7bca-4686-abc5-99b5956a8184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:03.769139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91874d-7bca-4686-abc5-99b5956a8184 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.778986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 964/1948] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:03.783137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91874d-7bca-4686-abc5-99b5956a8184 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:03.792322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91874d-7bca-4686-abc5-99b5956a8184 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:03.796960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03b326-31cf-4995-b156-eeb77b2f04af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:03.797583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03b326-31cf-4995-b156-eeb77b2f04af admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.797866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03b326-31cf-4995-b156-eeb77b2f04af admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.798172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03b326-31cf-4995-b156-eeb77b2f04af admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.798874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03b326-31cf-4995-b156-eeb77b2f04af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:03.800528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03b326-31cf-4995-b156-eeb77b2f04af admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.808239 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35529c-6ff5-4e1c-b9b5-62cf3a77dd35 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:03.812888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 965/1949] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:03.813009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb3ac-b73e-4c71-860a-aaf4a06d40b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:03.813009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb3ac-b73e-4c71-860a-aaf4a06d40b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.813187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb3ac-b73e-4c71-860a-aaf4a06d40b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.813356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb3ac-b73e-4c71-860a-aaf4a06d40b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.813814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03b326-31cf-4995-b156-eeb77b2f04af admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:03.822919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aceb3ac-b73e-4c71-860a-aaf4a06d40b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:03.823322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03b326-31cf-4995-b156-eeb77b2f04af admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:03.824338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aceb3ac-b73e-4c71-860a-aaf4a06d40b4 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.828449 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c934-317c-4d17-9555-8819313bffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:03.829290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c934-317c-4d17-9555-8819313bffc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.829601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c934-317c-4d17-9555-8819313bffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.829876 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c934-317c-4d17-9555-8819313bffc7 admin admin] PATH_INFO: `/v3/projects/de2fe1a196984ea1929aec4bb5e3fcc4/users/6e1dd15f6d2f4fcf8f37da31a1fced29/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.834269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 985/1950] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:03.844758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53c934-317c-4d17-9555-8819313bffc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2fe1a196984ea1929aec4bb5e3fcc4, user_id=6e1dd15f6d2f4fcf8f37da31a1fced29, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:03.848779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53c934-317c-4d17-9555-8819313bffc7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:03.916014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 966/1951] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:03 2022] PUT /identity/v3/projects/de2fe1a196984ea1929aec4bb5e3fcc4/users/6e1dd15f6d2f4fcf8f37da31a1fced29/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:03.928058 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de780f-406a-419e-b8ef-7dc82d3c970f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:03.928439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de780f-406a-419e-b8ef-7dc82d3c970f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:03.928782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de780f-406a-419e-b8ef-7dc82d3c970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:03.955756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-59de780f-406a-419e-b8ef-7dc82d3c970f None None] MFA Rules not processed for user `6e1dd15f6d2f4fcf8f37da31a1fced29`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:03.956953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-59de780f-406a-419e-b8ef-7dc82d3c970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:04.020777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 986/1952] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:04.025255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c934-317c-4d17-9555-8819313bffc7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:04.098184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c934-317c-4d17-9555-8819313bffc7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:04.103943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116c962-9d7b-49d9-a75a-099c0477781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:04.104611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116c962-9d7b-49d9-a75a-099c0477781d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.110951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116c962-9d7b-49d9-a75a-099c0477781d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.110951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116c962-9d7b-49d9-a75a-099c0477781d admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.110951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116c962-9d7b-49d9-a75a-099c0477781d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:04.110951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116c962-9d7b-49d9-a75a-099c0477781d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:04.222032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 967/1953] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:04 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:04.226399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de780f-406a-419e-b8ef-7dc82d3c970f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:04.239546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de780f-406a-419e-b8ef-7dc82d3c970f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:04.304944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116c962-9d7b-49d9-a75a-099c0477781d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:04.307002 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9116c962-9d7b-49d9-a75a-099c0477781d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:04.316815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664a3de-1747-45a9-ac0b-bfcaece44e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:04.317776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664a3de-1747-45a9-ac0b-bfcaece44e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.318416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664a3de-1747-45a9-ac0b-bfcaece44e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.318857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664a3de-1747-45a9-ac0b-bfcaece44e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.319798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664a3de-1747-45a9-ac0b-bfcaece44e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:04.320723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116c962-9d7b-49d9-a75a-099c0477781d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:04.322401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664a3de-1747-45a9-ac0b-bfcaece44e3e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:04.325950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:04.327101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.327512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.327992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] PATH_INFO: `/v3/projects/671c7ab3f9a24ab790a27dfb3e04350e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.329321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671c7ab3f9a24ab790a27dfb3e04350e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:04.332736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:04.473110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 987/1954] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:04 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:04.476854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664a3de-1747-45a9-ac0b-bfcaece44e3e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:04.492250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664a3de-1747-45a9-ac0b-bfcaece44e3e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:04.494504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671c7ab3f9a24ab790a27dfb3e04350e', 'request_id': 'req-438493ed-541a-4492-acce-b19cfc7ebe27'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:04.516896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671c7ab3f9a24ab790a27dfb3e04350e', 'request_id': 'req-438493ed-541a-4492-acce-b19cfc7ebe27'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:04.525875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671c7ab3f9a24ab790a27dfb3e04350e', 'request_id': 'req-438493ed-541a-4492-acce-b19cfc7ebe27'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:04.568500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa791c9f-c516-43ac-9183-ea10870c6029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:04.569173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa791c9f-c516-43ac-9183-ea10870c6029 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.569456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa791c9f-c516-43ac-9183-ea10870c6029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.569729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa791c9f-c516-43ac-9183-ea10870c6029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.570494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa791c9f-c516-43ac-9183-ea10870c6029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:04.572375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa791c9f-c516-43ac-9183-ea10870c6029 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:04.582249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 988/1955] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:04.586141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa791c9f-c516-43ac-9183-ea10870c6029 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:04.595936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa791c9f-c516-43ac-9183-ea10870c6029 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:04.601026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adcf0e-a35f-4e98-a620-9aa4541f0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:04.601686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adcf0e-a35f-4e98-a620-9aa4541f0502 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.601965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adcf0e-a35f-4e98-a620-9aa4541f0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.602301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adcf0e-a35f-4e98-a620-9aa4541f0502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.603683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adcf0e-a35f-4e98-a620-9aa4541f0502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:04.605063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adcf0e-a35f-4e98-a620-9aa4541f0502 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:04.628071 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 989/1956] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:04.628071 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adcf0e-a35f-4e98-a620-9aa4541f0502 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:04.634110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] The token cache is being invalidate because project 671c7ab3f9a24ab790a27dfb3e04350e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:04.634523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:04.637490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-438493ed-541a-4492-acce-b19cfc7ebe27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:04.640549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 968/1957] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:04 2022] DELETE /identity/v3/projects/671c7ab3f9a24ab790a27dfb3e04350e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:04.644630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2b77b-aabd-4edd-8f07-5a2560769641 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.644924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2b77b-aabd-4edd-8f07-5a2560769641 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.645182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2b77b-aabd-4edd-8f07-5a2560769641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.647504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adcf0e-a35f-4e98-a620-9aa4541f0502 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:04.654764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f300a-2799-440c-bf54-39438db62413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:04.656537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f300a-2799-440c-bf54-39438db62413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.656537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f300a-2799-440c-bf54-39438db62413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.656537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f300a-2799-440c-bf54-39438db62413 admin admin] PATH_INFO: `/v3/projects/09ba20b2b8504bc3838890f59ae506b9/users/1f0dc0b8a4874ef087ec676f82123fb6/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.671207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-eee2b77b-aabd-4edd-8f07-5a2560769641 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:04.672636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-eee2b77b-aabd-4edd-8f07-5a2560769641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:04.678436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f300a-2799-440c-bf54-39438db62413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ba20b2b8504bc3838890f59ae506b9, user_id=1f0dc0b8a4874ef087ec676f82123fb6, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:04.681028 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 969/1958] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:04.681269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f300a-2799-440c-bf54-39438db62413 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:04.688686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbee1ea-8ac9-42b2-8f26-90186cfe900f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.688975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbee1ea-8ac9-42b2-8f26-90186cfe900f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.689255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbee1ea-8ac9-42b2-8f26-90186cfe900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.707248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-afbee1ea-8ac9-42b2-8f26-90186cfe900f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:04.708436 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-afbee1ea-8ac9-42b2-8f26-90186cfe900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:04.716619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 970/1959] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:04.720550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbee1ea-8ac9-42b2-8f26-90186cfe900f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:04.735471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbee1ea-8ac9-42b2-8f26-90186cfe900f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:04.735471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88cbda-8025-4e7f-b105-906c23ff7ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:04.735471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88cbda-8025-4e7f-b105-906c23ff7ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.735887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88cbda-8025-4e7f-b105-906c23ff7ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.736020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88cbda-8025-4e7f-b105-906c23ff7ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.736747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88cbda-8025-4e7f-b105-906c23ff7ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:04.737056 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88cbda-8025-4e7f-b105-906c23ff7ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:04.738709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88cbda-8025-4e7f-b105-906c23ff7ff1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:04.750411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 971/1960] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:16:04.757490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88cbda-8025-4e7f-b105-906c23ff7ff1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:04.761961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 990/1961] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:04 2022] PUT /identity/v3/projects/09ba20b2b8504bc3838890f59ae506b9/users/1f0dc0b8a4874ef087ec676f82123fb6/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:04.772360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e1e0a-b147-49bd-a595-cc74da8bd0a1 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.772816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e1e0a-b147-49bd-a595-cc74da8bd0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.772897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e1e0a-b147-49bd-a595-cc74da8bd0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.787024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88cbda-8025-4e7f-b105-906c23ff7ff1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:04.807424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9d1e1e0a-b147-49bd-a595-cc74da8bd0a1 None None] MFA Rules not processed for user `1f0dc0b8a4874ef087ec676f82123fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:04.808800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9d1e1e0a-b147-49bd-a595-cc74da8bd0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:04.868396 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098f20c-504e-4db1-8d2c-d7d4d0304817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:04.869155 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098f20c-504e-4db1-8d2c-d7d4d0304817 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.869513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098f20c-504e-4db1-8d2c-d7d4d0304817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.869740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098f20c-504e-4db1-8d2c-d7d4d0304817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.870419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098f20c-504e-4db1-8d2c-d7d4d0304817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:04.872401 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098f20c-504e-4db1-8d2c-d7d4d0304817 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:04.881817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 991/1962] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:04.886365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e1e0a-b147-49bd-a595-cc74da8bd0a1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:04.887676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9d1e1e0a-b147-49bd-a595-cc74da8bd0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:04.901372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e1e0a-b147-49bd-a595-cc74da8bd0a1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:04.910569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ac9be-2765-4c30-b19c-327b0e97c269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:04.910569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ac9be-2765-4c30-b19c-327b0e97c269 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:04.910569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ac9be-2765-4c30-b19c-327b0e97c269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:04.910569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ac9be-2765-4c30-b19c-327b0e97c269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:04.911024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ac9be-2765-4c30-b19c-327b0e97c269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:04.911415 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ac9be-2765-4c30-b19c-327b0e97c269 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:04.983328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 972/1963] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:04 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:04.990476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098f20c-504e-4db1-8d2c-d7d4d0304817 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.013903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 992/1964] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:04 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:05.016352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ac9be-2765-4c30-b19c-327b0e97c269 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.071917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098f20c-504e-4db1-8d2c-d7d4d0304817 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.093723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ac9be-2765-4c30-b19c-327b0e97c269 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.099009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05bb21-5468-4fca-9170-c9be0bf6810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.099684 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05bb21-5468-4fca-9170-c9be0bf6810c admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.099967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05bb21-5468-4fca-9170-c9be0bf6810c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.100244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05bb21-5468-4fca-9170-c9be0bf6810c admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.100937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05bb21-5468-4fca-9170-c9be0bf6810c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.103287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05bb21-5468-4fca-9170-c9be0bf6810c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.144029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98969-ecca-4a3d-a3d5-2356f8911fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.144029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98969-ecca-4a3d-a3d5-2356f8911fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.144738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98969-ecca-4a3d-a3d5-2356f8911fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.145219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98969-ecca-4a3d-a3d5-2356f8911fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.146075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a98969-ecca-4a3d-a3d5-2356f8911fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.148014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a98969-ecca-4a3d-a3d5-2356f8911fd4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.203144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 993/1965] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:05 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:05.207340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05bb21-5468-4fca-9170-c9be0bf6810c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.218558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05bb21-5468-4fca-9170-c9be0bf6810c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.223266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e4701-de8d-4428-84a7-aa19d113a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.223921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e4701-de8d-4428-84a7-aa19d113a104 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.224198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e4701-de8d-4428-84a7-aa19d113a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.224467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e4701-de8d-4428-84a7-aa19d113a104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.225184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e4701-de8d-4428-84a7-aa19d113a104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.226795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e4701-de8d-4428-84a7-aa19d113a104 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.238932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 994/1966] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:05.244034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 973/1967] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:04 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:05.244169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e4701-de8d-4428-84a7-aa19d113a104 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.245538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98969-ecca-4a3d-a3d5-2356f8911fd4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.253499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e4701-de8d-4428-84a7-aa19d113a104 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.256097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98969-ecca-4a3d-a3d5-2356f8911fd4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.258267 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297d401-13f1-4a15-aca8-9e8e6c9199a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.259205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297d401-13f1-4a15-aca8-9e8e6c9199a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.259483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297d401-13f1-4a15-aca8-9e8e6c9199a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.259749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297d401-13f1-4a15-aca8-9e8e6c9199a1 admin admin] PATH_INFO: `/v3/projects/6292baea82db4b529333db401a91cb19/users/c5c13dfc98674ee492a61b79937353ec/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.262590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b03b1-af8d-497c-a86f-2d823289dd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.264613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b03b1-af8d-497c-a86f-2d823289dd1c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.264895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b03b1-af8d-497c-a86f-2d823289dd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.265172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b03b1-af8d-497c-a86f-2d823289dd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.265902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b03b1-af8d-497c-a86f-2d823289dd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.267753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b03b1-af8d-497c-a86f-2d823289dd1c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.275960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297d401-13f1-4a15-aca8-9e8e6c9199a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6292baea82db4b529333db401a91cb19, user_id=c5c13dfc98674ee492a61b79937353ec, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.279249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297d401-13f1-4a15-aca8-9e8e6c9199a1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.280599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 974/1968] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:05.285369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b03b1-af8d-497c-a86f-2d823289dd1c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.295030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b03b1-af8d-497c-a86f-2d823289dd1c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.299645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba847d-3a44-4025-8094-bcc7018a5d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.300293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba847d-3a44-4025-8094-bcc7018a5d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.300576 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba847d-3a44-4025-8094-bcc7018a5d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.300868 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba847d-3a44-4025-8094-bcc7018a5d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.301596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba847d-3a44-4025-8094-bcc7018a5d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.303298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba847d-3a44-4025-8094-bcc7018a5d6f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.313638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 975/1969] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:05.329311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba847d-3a44-4025-8094-bcc7018a5d6f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.339143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba847d-3a44-4025-8094-bcc7018a5d6f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.344413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b8b5e-810d-4b7e-a789-a8103d3af698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.345285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b8b5e-810d-4b7e-a789-a8103d3af698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.345691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b8b5e-810d-4b7e-a789-a8103d3af698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.345965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b8b5e-810d-4b7e-a789-a8103d3af698 admin admin] PATH_INFO: `/v3/projects/b5d58755d6414abca0c50beb7325f8a6/users/333cf6ad4eed46af9d61859f6e72dc25/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.362742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b8b5e-810d-4b7e-a789-a8103d3af698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d58755d6414abca0c50beb7325f8a6, user_id=333cf6ad4eed46af9d61859f6e72dc25, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.371485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b8b5e-810d-4b7e-a789-a8103d3af698 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.403331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 995/1970] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:05 2022] PUT /identity/v3/projects/6292baea82db4b529333db401a91cb19/users/c5c13dfc98674ee492a61b79937353ec/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:05.407368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297d401-13f1-4a15-aca8-9e8e6c9199a1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.455451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 976/1971] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:05 2022] PUT /identity/v3/projects/b5d58755d6414abca0c50beb7325f8a6/users/333cf6ad4eed46af9d61859f6e72dc25/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:05.468146 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc3882-eb51-4df1-83b4-0690c80e92f7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.468433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc3882-eb51-4df1-83b4-0690c80e92f7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.469335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc3882-eb51-4df1-83b4-0690c80e92f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.473886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297d401-13f1-4a15-aca8-9e8e6c9199a1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.495886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-37bc3882-eb51-4df1-83b4-0690c80e92f7 None None] MFA Rules not processed for user `333cf6ad4eed46af9d61859f6e72dc25`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:05.497985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-37bc3882-eb51-4df1-83b4-0690c80e92f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:05.537137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4a25-b3bb-4c01-9a01-4aa22c51a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.537723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4a25-b3bb-4c01-9a01-4aa22c51a926 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.538004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4a25-b3bb-4c01-9a01-4aa22c51a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.538313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4a25-b3bb-4c01-9a01-4aa22c51a926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.539081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb4a25-b3bb-4c01-9a01-4aa22c51a926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.540827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb4a25-b3bb-4c01-9a01-4aa22c51a926 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.559162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 996/1972] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:05.561277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4a25-b3bb-4c01-9a01-4aa22c51a926 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.567856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 977/1973] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:05.573188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc3882-eb51-4df1-83b4-0690c80e92f7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.573721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4a25-b3bb-4c01-9a01-4aa22c51a926 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.574980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-37bc3882-eb51-4df1-83b4-0690c80e92f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:05.580137 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d495-b77c-4d2b-8a29-0f3fc7250418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.581506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d495-b77c-4d2b-8a29-0f3fc7250418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.581869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d495-b77c-4d2b-8a29-0f3fc7250418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.582269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1d495-b77c-4d2b-8a29-0f3fc7250418 admin admin] PATH_INFO: `/v3/projects/6292baea82db4b529333db401a91cb19/users/c5c13dfc98674ee492a61b79937353ec/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.584461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1d495-b77c-4d2b-8a29-0f3fc7250418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6292baea82db4b529333db401a91cb19, user_id=c5c13dfc98674ee492a61b79937353ec, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.587255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1d495-b77c-4d2b-8a29-0f3fc7250418 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.590676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc3882-eb51-4df1-83b4-0690c80e92f7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.595713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.596710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.597061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.597398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] PATH_INFO: `/v3/users/560ec1c436334d53879fc2830a40b168` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.598816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560ec1c436334d53879fc2830a40b168)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.607862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 997/1974] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:05 2022] PUT /identity/v3/projects/6292baea82db4b529333db401a91cb19/users/c5c13dfc98674ee492a61b79937353ec/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:05.607862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d495-b77c-4d2b-8a29-0f3fc7250418 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.608121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.609349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-99c1d495-b77c-4d2b-8a29-0f3fc7250418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:05.670464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1d495-b77c-4d2b-8a29-0f3fc7250418 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.675910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b4564-cc49-4aaf-ae3a-667f76028fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:05.676912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b4564-cc49-4aaf-ae3a-667f76028fba service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.677868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b4564-cc49-4aaf-ae3a-667f76028fba service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.677868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b4564-cc49-4aaf-ae3a-667f76028fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.742218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b4564-cc49-4aaf-ae3a-667f76028fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:05.743666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b4564-cc49-4aaf-ae3a-667f76028fba service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:05.753943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 998/1975] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:05.759332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6b4d-8dc8-4aa1-816f-3a1e2c1d37ae None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.759621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6b4d-8dc8-4aa1-816f-3a1e2c1d37ae None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.759898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6b4d-8dc8-4aa1-816f-3a1e2c1d37ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.771222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560ec1c436334d53879fc2830a40b168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:05.772414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560ec1c436334d53879fc2830a40b168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:05.788506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560ec1c436334d53879fc2830a40b168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:05.789352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560ec1c436334d53879fc2830a40b168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:05.799750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a627235a-fbfa-43d6-8502-8cb104e5a917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560ec1c436334d53879fc2830a40b168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:05.819455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ec8d6b4d-8dc8-4aa1-816f-3a1e2c1d37ae None None] MFA Rules not processed for user `c5c13dfc98674ee492a61b79937353ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:05.820923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ec8d6b4d-8dc8-4aa1-816f-3a1e2c1d37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:05.870076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 978/1976] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:05 2022] DELETE /identity/v3/users/560ec1c436334d53879fc2830a40b168 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:05.872368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52646c-6afb-45ca-a3e9-1fd58fd9f765 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:05.873158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52646c-6afb-45ca-a3e9-1fd58fd9f765 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:05.873421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52646c-6afb-45ca-a3e9-1fd58fd9f765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:05.897668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7d52646c-6afb-45ca-a3e9-1fd58fd9f765 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:05.899540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7d52646c-6afb-45ca-a3e9-1fd58fd9f765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:05.954924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 999/1977] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:05.966526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6b4d-8dc8-4aa1-816f-3a1e2c1d37ae None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.968045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ec8d6b4d-8dc8-4aa1-816f-3a1e2c1d37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:05.979135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 979/1978] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:05.983952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6b4d-8dc8-4aa1-816f-3a1e2c1d37ae None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:05.990444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52646c-6afb-45ca-a3e9-1fd58fd9f765 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:05.992451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7d52646c-6afb-45ca-a3e9-1fd58fd9f765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:06.039186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741499a-457f-4b55-9694-84894c0fdd8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:06.040447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741499a-457f-4b55-9694-84894c0fdd8b service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:06.040733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741499a-457f-4b55-9694-84894c0fdd8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:06.042402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741499a-457f-4b55-9694-84894c0fdd8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:06.042901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5741499a-457f-4b55-9694-84894c0fdd8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:06.080017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52646c-6afb-45ca-a3e9-1fd58fd9f765 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:06.086173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3e9e-db72-49b3-9be0-f2873d47bef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:06.087434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3e9e-db72-49b3-9be0-f2873d47bef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:06.087728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3e9e-db72-49b3-9be0-f2873d47bef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:06.088011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3e9e-db72-49b3-9be0-f2873d47bef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:06.100589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3e9e-db72-49b3-9be0-f2873d47bef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:06.101108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3e9e-db72-49b3-9be0-f2873d47bef5 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:06.105337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741499a-457f-4b55-9694-84894c0fdd8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:06.107434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741499a-457f-4b55-9694-84894c0fdd8b service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:06.111884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 980/1979] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:06.117040 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1000/1980] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:06.588813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3e9e-db72-49b3-9be0-f2873d47bef5 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:06.590383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-dece3e9e-db72-49b3-9be0-f2873d47bef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:06.635601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3e9e-db72-49b3-9be0-f2873d47bef5 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:06.648242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:06.653244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:06.653244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:06.653244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] PATH_INFO: `/v3/projects/7e3b89bf42c2413fb175f678b9f9f394` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:06.653244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3b89bf42c2413fb175f678b9f9f394)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:06.655937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:06.771142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3b89bf42c2413fb175f678b9f9f394', 'request_id': 'req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:06.779771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3b89bf42c2413fb175f678b9f9f394', 'request_id': 'req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:06.785849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3b89bf42c2413fb175f678b9f9f394', 'request_id': 'req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:06.876771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] The token cache is being invalidate because project 7e3b89bf42c2413fb175f678b9f9f394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:06.881142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:06.881142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:06.881142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 981/1981] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:06 2022] DELETE /identity/v3/projects/7e3b89bf42c2413fb175f678b9f9f394 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:06.883309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741499a-457f-4b55-9694-84894c0fdd8b service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:06.919799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741499a-457f-4b55-9694-84894c0fdd8b service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:07.073089 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:07.074034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:07.084859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:07.085101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] PATH_INFO: `/v3/users/f51c8412b08243f8a069b3bf5fcf0bc4` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:07.086617 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51c8412b08243f8a069b3bf5fcf0bc4)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:07.088948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:07.327133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51c8412b08243f8a069b3bf5fcf0bc4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:07.327933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51c8412b08243f8a069b3bf5fcf0bc4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:07.328556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51c8412b08243f8a069b3bf5fcf0bc4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:07.340633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51c8412b08243f8a069b3bf5fcf0bc4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:07.347458 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e537a87f-ffd0-47ea-97da-0c8cbf5bc9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51c8412b08243f8a069b3bf5fcf0bc4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:07.529632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1001/1982] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:06 2022] DELETE /identity/v3/users/f51c8412b08243f8a069b3bf5fcf0bc4 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:08.038795 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:08.040598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:08.059978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f55e-92e0-481e-9ffe-9e57d6233ddd admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:08.189415 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:08.190332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:08.190612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:08.190884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] PATH_INFO: `/v3/projects/83cd4701636647adbf26bad2818a3fec` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:08.192108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cd4701636647adbf26bad2818a3fec)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:08.194129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:08.310931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cd4701636647adbf26bad2818a3fec', 'request_id': 'req-4a01bc04-2729-4ab2-a39e-122433997ea2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:08.317188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cd4701636647adbf26bad2818a3fec', 'request_id': 'req-4a01bc04-2729-4ab2-a39e-122433997ea2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:08.323778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cd4701636647adbf26bad2818a3fec', 'request_id': 'req-4a01bc04-2729-4ab2-a39e-122433997ea2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:08.400939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] The token cache is being invalidate because project 83cd4701636647adbf26bad2818a3fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:08.401370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:08.401993 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4a01bc04-2729-4ab2-a39e-122433997ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:08.403903 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 982/1983] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:08 2022] DELETE /identity/v3/projects/83cd4701636647adbf26bad2818a3fec => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:08.408792 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8c01-e726-47e7-b85d-8e84bca01cfd None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:08.409296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8c01-e726-47e7-b85d-8e84bca01cfd None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:08.409374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8c01-e726-47e7-b85d-8e84bca01cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:08.427571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-823a8c01-e726-47e7-b85d-8e84bca01cfd None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:08.428862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-823a8c01-e726-47e7-b85d-8e84bca01cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:08.492223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1002/1984] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:08.501606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ee34-f397-4e70-ad81-a4e72f7119f9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:08.501994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ee34-f397-4e70-ad81-a4e72f7119f9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:08.502317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ee34-f397-4e70-ad81-a4e72f7119f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:08.522211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0211ee34-f397-4e70-ad81-a4e72f7119f9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:08.523418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0211ee34-f397-4e70-ad81-a4e72f7119f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:08.531475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 983/1985] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:08.535850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8c01-e726-47e7-b85d-8e84bca01cfd None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:08.545545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8c01-e726-47e7-b85d-8e84bca01cfd None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:08.550659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf3323-cf86-4035-978d-33237e96912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:08.551321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf3323-cf86-4035-978d-33237e96912d admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:08.551603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf3323-cf86-4035-978d-33237e96912d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:08.551884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf3323-cf86-4035-978d-33237e96912d admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:08.552614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf3323-cf86-4035-978d-33237e96912d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:08.552923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf3323-cf86-4035-978d-33237e96912d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:08.554573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf3323-cf86-4035-978d-33237e96912d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:08.570999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1003/1986] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:16:08.571261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211ee34-f397-4e70-ad81-a4e72f7119f9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:08.580862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211ee34-f397-4e70-ad81-a4e72f7119f9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:08.586242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81281f93-5d1b-42b5-9db0-7685fc7f348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:08.586901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81281f93-5d1b-42b5-9db0-7685fc7f348e admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:08.587183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81281f93-5d1b-42b5-9db0-7685fc7f348e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:08.587457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81281f93-5d1b-42b5-9db0-7685fc7f348e admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:08.588405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81281f93-5d1b-42b5-9db0-7685fc7f348e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:08.590113 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81281f93-5d1b-42b5-9db0-7685fc7f348e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:08.665770 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 984/1987] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:08 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:08.670283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf3323-cf86-4035-978d-33237e96912d admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:08.680240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf3323-cf86-4035-978d-33237e96912d admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:08.737789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635fadb-f76b-44cf-90c9-254afee5d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:08.738630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635fadb-f76b-44cf-90c9-254afee5d714 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:08.739378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635fadb-f76b-44cf-90c9-254afee5d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:08.739378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635fadb-f76b-44cf-90c9-254afee5d714 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:08.739994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635fadb-f76b-44cf-90c9-254afee5d714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:08.741961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635fadb-f76b-44cf-90c9-254afee5d714 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:08.820798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1004/1988] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:08 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:08.825782 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81281f93-5d1b-42b5-9db0-7685fc7f348e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:08.836235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81281f93-5d1b-42b5-9db0-7685fc7f348e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:08.841710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e75ec-1f9c-4a37-be1f-12b1b3f8753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:08.842414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e75ec-1f9c-4a37-be1f-12b1b3f8753d admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:08.842695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e75ec-1f9c-4a37-be1f-12b1b3f8753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:08.842972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e75ec-1f9c-4a37-be1f-12b1b3f8753d admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:08.843911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e75ec-1f9c-4a37-be1f-12b1b3f8753d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:08.847226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e75ec-1f9c-4a37-be1f-12b1b3f8753d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:08.863218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 985/1989] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:08.864307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635fadb-f76b-44cf-90c9-254afee5d714 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:08.881587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635fadb-f76b-44cf-90c9-254afee5d714 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:08.889377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262fd55-803e-40c2-93ed-e0439497e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:08.890163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262fd55-803e-40c2-93ed-e0439497e1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:08.890944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262fd55-803e-40c2-93ed-e0439497e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:08.891301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262fd55-803e-40c2-93ed-e0439497e1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:08.892099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262fd55-803e-40c2-93ed-e0439497e1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:08.893768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262fd55-803e-40c2-93ed-e0439497e1d0 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:08.910385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e75ec-1f9c-4a37-be1f-12b1b3f8753d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:08.914180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1005/1990] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:08.921121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e75ec-1f9c-4a37-be1f-12b1b3f8753d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:08.926898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b8843-240b-4d8a-ae5e-716649b77446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:08.927860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b8843-240b-4d8a-ae5e-716649b77446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:08.928264 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b8843-240b-4d8a-ae5e-716649b77446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:08.928515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b8843-240b-4d8a-ae5e-716649b77446 admin admin] PATH_INFO: `/v3/projects/8f5a50f5a8c244bcac3ac5701a0bf095/users/11a44dc3e02d4578a7dd5e2a6050f3b8/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:08.943692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b8843-240b-4d8a-ae5e-716649b77446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5a50f5a8c244bcac3ac5701a0bf095, user_id=11a44dc3e02d4578a7dd5e2a6050f3b8, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:08.946740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b8843-240b-4d8a-ae5e-716649b77446 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:09.015247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 986/1991] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:08 2022] PUT /identity/v3/projects/8f5a50f5a8c244bcac3ac5701a0bf095/users/11a44dc3e02d4578a7dd5e2a6050f3b8/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:09.025618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb2551-0689-4efb-a216-3b77bdd0744b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:09.025989 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb2551-0689-4efb-a216-3b77bdd0744b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:09.026370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb2551-0689-4efb-a216-3b77bdd0744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:09.053683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-75cb2551-0689-4efb-a216-3b77bdd0744b None None] MFA Rules not processed for user `11a44dc3e02d4578a7dd5e2a6050f3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:09.054920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-75cb2551-0689-4efb-a216-3b77bdd0744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:09.126396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1006/1992] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:09.130795 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b8843-240b-4d8a-ae5e-716649b77446 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:09.211033 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b8843-240b-4d8a-ae5e-716649b77446 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:09.215655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97878161-2712-4d98-92a5-d592f45e5b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:09.216929 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97878161-2712-4d98-92a5-d592f45e5b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:09.217156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97878161-2712-4d98-92a5-d592f45e5b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:09.217428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97878161-2712-4d98-92a5-d592f45e5b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:09.218153 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97878161-2712-4d98-92a5-d592f45e5b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:09.220061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97878161-2712-4d98-92a5-d592f45e5b3b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:09.304084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 987/1993] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:09 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:09.305188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb2551-0689-4efb-a216-3b77bdd0744b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:09.315638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb2551-0689-4efb-a216-3b77bdd0744b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:09.370341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1db14-b40b-42e3-8ca1-f68765255d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:09.370930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1db14-b40b-42e3-8ca1-f68765255d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:09.371207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1db14-b40b-42e3-8ca1-f68765255d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:09.371477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1db14-b40b-42e3-8ca1-f68765255d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:09.372830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1db14-b40b-42e3-8ca1-f68765255d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:09.374828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1db14-b40b-42e3-8ca1-f68765255d0b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:09.474354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1007/1994] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:09 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:09.483226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97878161-2712-4d98-92a5-d592f45e5b3b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:09.493348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97878161-2712-4d98-92a5-d592f45e5b3b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:09.498036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74ea4-34d5-4f92-b9fe-0032a12bb1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:09.498727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74ea4-34d5-4f92-b9fe-0032a12bb1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:09.499011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74ea4-34d5-4f92-b9fe-0032a12bb1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:09.499284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74ea4-34d5-4f92-b9fe-0032a12bb1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:09.500004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74ea4-34d5-4f92-b9fe-0032a12bb1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:09.501596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74ea4-34d5-4f92-b9fe-0032a12bb1bd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:09.512002 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 988/1995] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:09.516654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1db14-b40b-42e3-8ca1-f68765255d0b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:09.526801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1db14-b40b-42e3-8ca1-f68765255d0b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:09.532379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aad589-364b-482d-8df2-10d55ae64826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:09.533259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aad589-364b-482d-8df2-10d55ae64826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:09.533537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aad589-364b-482d-8df2-10d55ae64826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:09.533810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aad589-364b-482d-8df2-10d55ae64826 admin admin] PATH_INFO: `/v3/projects/f5d7a166b6204323822c7474451362a9/users/72c59d1cbba845c2b51b29e1b2fff305/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:09.548301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aad589-364b-482d-8df2-10d55ae64826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d7a166b6204323822c7474451362a9, user_id=72c59d1cbba845c2b51b29e1b2fff305, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:09.550987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aad589-364b-482d-8df2-10d55ae64826 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:09.611119 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1008/1996] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:09 2022] PUT /identity/v3/projects/f5d7a166b6204323822c7474451362a9/users/72c59d1cbba845c2b51b29e1b2fff305/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:09.615019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74ea4-34d5-4f92-b9fe-0032a12bb1bd admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:09.625127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74ea4-34d5-4f92-b9fe-0032a12bb1bd admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:09.688365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd08ed-1ba2-4a25-bcb3-a8481f307302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:09.689033 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd08ed-1ba2-4a25-bcb3-a8481f307302 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:09.689309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd08ed-1ba2-4a25-bcb3-a8481f307302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:09.689581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd08ed-1ba2-4a25-bcb3-a8481f307302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:09.690337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd08ed-1ba2-4a25-bcb3-a8481f307302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:09.691921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd08ed-1ba2-4a25-bcb3-a8481f307302 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:09.703121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 989/1997] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:09.707287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aad589-364b-482d-8df2-10d55ae64826 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:09.718405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aad589-364b-482d-8df2-10d55ae64826 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:09.723338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cfc89-7bb3-407e-a290-3773383a9144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:09.724213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cfc89-7bb3-407e-a290-3773383a9144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:09.724489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cfc89-7bb3-407e-a290-3773383a9144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:09.724756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cfc89-7bb3-407e-a290-3773383a9144 admin admin] PATH_INFO: `/v3/projects/f5d7a166b6204323822c7474451362a9/users/72c59d1cbba845c2b51b29e1b2fff305/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:09.726733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cfc89-7bb3-407e-a290-3773383a9144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d7a166b6204323822c7474451362a9, user_id=72c59d1cbba845c2b51b29e1b2fff305, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:09.729714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cfc89-7bb3-407e-a290-3773383a9144 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:09.740483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1009/1998] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:09 2022] PUT /identity/v3/projects/f5d7a166b6204323822c7474451362a9/users/72c59d1cbba845c2b51b29e1b2fff305/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:09.750857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7fa97-7d30-404a-a122-046319e949fb None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:09.751148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7fa97-7d30-404a-a122-046319e949fb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:09.751420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7fa97-7d30-404a-a122-046319e949fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:09.778890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cef7fa97-7d30-404a-a122-046319e949fb None None] MFA Rules not processed for user `72c59d1cbba845c2b51b29e1b2fff305`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:09.780096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cef7fa97-7d30-404a-a122-046319e949fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:09.851999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 990/1999] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:09.863164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cfc89-7bb3-407e-a290-3773383a9144 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:09.864836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fe7cfc89-7bb3-407e-a290-3773383a9144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:09.928016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cfc89-7bb3-407e-a290-3773383a9144 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:09.932179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f40f6a-0896-439e-8c98-8b9320cd4397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:09.932842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f40f6a-0896-439e-8c98-8b9320cd4397 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:09.933486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f40f6a-0896-439e-8c98-8b9320cd4397 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:09.933620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f40f6a-0896-439e-8c98-8b9320cd4397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:09.998725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f40f6a-0896-439e-8c98-8b9320cd4397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:10.002030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f40f6a-0896-439e-8c98-8b9320cd4397 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:10.011714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1010/2000] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:16.425131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7fa97-7d30-404a-a122-046319e949fb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:16.426622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cef7fa97-7d30-404a-a122-046319e949fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:16.438588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7fa97-7d30-404a-a122-046319e949fb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:16.443628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef087eb-6ec4-42d3-96d8-bef0b36e6ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:16.443628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef087eb-6ec4-42d3-96d8-bef0b36e6ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:16.443628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef087eb-6ec4-42d3-96d8-bef0b36e6ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:16.443628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef087eb-6ec4-42d3-96d8-bef0b36e6ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:16.445001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4ef087eb-6ec4-42d3-96d8-bef0b36e6ed6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:16.504960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef087eb-6ec4-42d3-96d8-bef0b36e6ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:16.506441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef087eb-6ec4-42d3-96d8-bef0b36e6ed6 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:16.515499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 991/2001] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:19.133408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f40f6a-0896-439e-8c98-8b9320cd4397 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:19.142358 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f40f6a-0896-439e-8c98-8b9320cd4397 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:19.145974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60903b53-d8e9-4c69-8fef-af69194b3762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:19.146654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60903b53-d8e9-4c69-8fef-af69194b3762 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:19.146936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60903b53-d8e9-4c69-8fef-af69194b3762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:19.147238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60903b53-d8e9-4c69-8fef-af69194b3762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:19.149024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-60903b53-d8e9-4c69-8fef-af69194b3762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:19.209520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60903b53-d8e9-4c69-8fef-af69194b3762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:19.211009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60903b53-d8e9-4c69-8fef-af69194b3762 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:19.220294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1011/2002] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:23.943707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef087eb-6ec4-42d3-96d8-bef0b36e6ed6 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:24.012150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef087eb-6ec4-42d3-96d8-bef0b36e6ed6 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:24.012150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:24.012150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:24.012150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:24.012634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] PATH_INFO: `/v3/users/11a44dc3e02d4578a7dd5e2a6050f3b8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:24.012846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a44dc3e02d4578a7dd5e2a6050f3b8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:24.014910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:24.251996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a44dc3e02d4578a7dd5e2a6050f3b8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:24.252675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a44dc3e02d4578a7dd5e2a6050f3b8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:24.264852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a44dc3e02d4578a7dd5e2a6050f3b8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:24.265524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a44dc3e02d4578a7dd5e2a6050f3b8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:24.275773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a44dc3e02d4578a7dd5e2a6050f3b8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:24.359773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 992/2003] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:23 2022] DELETE /identity/v3/users/11a44dc3e02d4578a7dd5e2a6050f3b8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:24.364509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856b39-e2c8-4721-bfde-a46bc130d44f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:24.364988 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856b39-e2c8-4721-bfde-a46bc130d44f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:24.365112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856b39-e2c8-4721-bfde-a46bc130d44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:24.381932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9a856b39-e2c8-4721-bfde-a46bc130d44f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:24.383143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9a856b39-e2c8-4721-bfde-a46bc130d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:24.447579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1012/2004] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:24.454645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:24.456052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:24.512758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a705e4-e4fc-4f62-b8f9-e8545b3c28e3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:24.516421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf08175-d41a-40ac-a265-320ac11cd062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:24.517069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf08175-d41a-40ac-a265-320ac11cd062 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:24.517354 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf08175-d41a-40ac-a265-320ac11cd062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:24.517654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf08175-d41a-40ac-a265-320ac11cd062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:24.526840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf08175-d41a-40ac-a265-320ac11cd062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:24.528780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf08175-d41a-40ac-a265-320ac11cd062 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:24.538117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 993/2005] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:24.947350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a856b39-e2c8-4721-bfde-a46bc130d44f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:24.948858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9a856b39-e2c8-4721-bfde-a46bc130d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:24.961740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a856b39-e2c8-4721-bfde-a46bc130d44f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:24.967564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:24.972205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:24.972205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:24.972205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] PATH_INFO: `/v3/projects/8f5a50f5a8c244bcac3ac5701a0bf095` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:24.972205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5a50f5a8c244bcac3ac5701a0bf095)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:24.972653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:25.087361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5a50f5a8c244bcac3ac5701a0bf095', 'request_id': 'req-78b483b2-7b09-4997-8fa6-947985180912'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.187063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5a50f5a8c244bcac3ac5701a0bf095', 'request_id': 'req-78b483b2-7b09-4997-8fa6-947985180912'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.192810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5a50f5a8c244bcac3ac5701a0bf095', 'request_id': 'req-78b483b2-7b09-4997-8fa6-947985180912'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.204737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] The token cache is being invalidate because project 8f5a50f5a8c244bcac3ac5701a0bf095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:25.204967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.205610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.207227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1013/2006] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:24 2022] DELETE /identity/v3/projects/8f5a50f5a8c244bcac3ac5701a0bf095 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:25.211235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf08175-d41a-40ac-a265-320ac11cd062 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:25.221662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf08175-d41a-40ac-a265-320ac11cd062 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:25.287165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:25.288036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:25.288318 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:25.288592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] PATH_INFO: `/v3/users/72c59d1cbba845c2b51b29e1b2fff305` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:25.289793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c59d1cbba845c2b51b29e1b2fff305)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:25.291794 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:25.476919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c59d1cbba845c2b51b29e1b2fff305'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.477828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c59d1cbba845c2b51b29e1b2fff305'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.491393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c59d1cbba845c2b51b29e1b2fff305'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.492343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c59d1cbba845c2b51b29e1b2fff305'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.501393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccd7b2dc-6423-4703-9253-be2e0fa91987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c59d1cbba845c2b51b29e1b2fff305'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:25.622099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 994/2007] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:25 2022] DELETE /identity/v3/users/72c59d1cbba845c2b51b29e1b2fff305 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:26.064714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:26.066222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:26.095588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b483b2-7b09-4997-8fa6-947985180912 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:26.159576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:26.160428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:26.160711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:26.167906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] PATH_INFO: `/v3/projects/f5d7a166b6204323822c7474451362a9` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:26.167906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d7a166b6204323822c7474451362a9)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:26.167906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:26.322023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d7a166b6204323822c7474451362a9', 'request_id': 'req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:26.400540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d7a166b6204323822c7474451362a9', 'request_id': 'req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:26.407780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d7a166b6204323822c7474451362a9', 'request_id': 'req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:26.420068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] The token cache is being invalidate because project f5d7a166b6204323822c7474451362a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:26.420068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:26.420418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e3e66422-d7a1-4ec3-b7c1-8b42c6cf9490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:26.421980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1014/2008] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:26 2022] DELETE /identity/v3/projects/f5d7a166b6204323822c7474451362a9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:26.433035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95996302-f989-4872-89d2-a54e2ff1fa4e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:26.433501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95996302-f989-4872-89d2-a54e2ff1fa4e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:26.433592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95996302-f989-4872-89d2-a54e2ff1fa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:26.451766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-95996302-f989-4872-89d2-a54e2ff1fa4e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:26.453078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-95996302-f989-4872-89d2-a54e2ff1fa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:26.510640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 995/2009] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:26.519052 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ed59f-ebf5-47f5-873b-47b53099277e None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:26.519350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ed59f-ebf5-47f5-873b-47b53099277e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:26.519705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ed59f-ebf5-47f5-873b-47b53099277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:26.539056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a54ed59f-ebf5-47f5-873b-47b53099277e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:26.540288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a54ed59f-ebf5-47f5-873b-47b53099277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:26.549589 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1015/2010] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:26.553825 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95996302-f989-4872-89d2-a54e2ff1fa4e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:26.564255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95996302-f989-4872-89d2-a54e2ff1fa4e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:26.569105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c5e4a-7531-4159-8633-e2a1089b2b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:26.570016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c5e4a-7531-4159-8633-e2a1089b2b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:26.570338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c5e4a-7531-4159-8633-e2a1089b2b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:26.570609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c5e4a-7531-4159-8633-e2a1089b2b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:26.571332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c5e4a-7531-4159-8633-e2a1089b2b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:26.571634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c5e4a-7531-4159-8633-e2a1089b2b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:26.573429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c5e4a-7531-4159-8633-e2a1089b2b5a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:26.594480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 996/2011] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:16:26.595669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ed59f-ebf5-47f5-873b-47b53099277e None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:26.614982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ed59f-ebf5-47f5-873b-47b53099277e None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:26.621802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029c058-8df6-4b68-9096-a644e3ae21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:26.622706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029c058-8df6-4b68-9096-a644e3ae21f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:26.623015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029c058-8df6-4b68-9096-a644e3ae21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:26.623295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029c058-8df6-4b68-9096-a644e3ae21f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:26.624047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029c058-8df6-4b68-9096-a644e3ae21f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:26.625999 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029c058-8df6-4b68-9096-a644e3ae21f9 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:26.735428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1016/2012] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:26 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:26.739203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c5e4a-7531-4159-8633-e2a1089b2b5a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:26.749832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c5e4a-7531-4159-8633-e2a1089b2b5a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:26.807949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed351e3d-29dc-4efc-b386-c8a547318fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:26.808888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351e3d-29dc-4efc-b386-c8a547318fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:26.809173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351e3d-29dc-4efc-b386-c8a547318fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:26.809629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed351e3d-29dc-4efc-b386-c8a547318fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:26.810369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed351e3d-29dc-4efc-b386-c8a547318fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:26.812274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed351e3d-29dc-4efc-b386-c8a547318fa9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:26.912955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 997/2013] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:26 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:26.917211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029c058-8df6-4b68-9096-a644e3ae21f9 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:26.928070 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029c058-8df6-4b68-9096-a644e3ae21f9 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:26.932760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e326592-7a70-4307-9d60-22d65a199c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:26.933413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e326592-7a70-4307-9d60-22d65a199c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:26.933699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e326592-7a70-4307-9d60-22d65a199c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:26.933980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e326592-7a70-4307-9d60-22d65a199c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:26.934732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e326592-7a70-4307-9d60-22d65a199c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:26.936409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e326592-7a70-4307-9d60-22d65a199c63 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:26.948015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1017/2014] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:26.951949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed351e3d-29dc-4efc-b386-c8a547318fa9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:26.963511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed351e3d-29dc-4efc-b386-c8a547318fa9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:26.968986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4e062-0444-440d-a53e-d09736ae5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:26.969641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e062-0444-440d-a53e-d09736ae5ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:26.969922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e062-0444-440d-a53e-d09736ae5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:26.970238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e062-0444-440d-a53e-d09736ae5ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:26.970961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4e062-0444-440d-a53e-d09736ae5ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:26.972632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4e062-0444-440d-a53e-d09736ae5ce4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:26.983240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 998/2015] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:26.988545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e326592-7a70-4307-9d60-22d65a199c63 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:26.998439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e326592-7a70-4307-9d60-22d65a199c63 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:27.003319 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271101e5-5835-4f8a-8d6f-82d009aa4fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:27.004153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271101e5-5835-4f8a-8d6f-82d009aa4fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:27.004425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271101e5-5835-4f8a-8d6f-82d009aa4fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:27.012923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271101e5-5835-4f8a-8d6f-82d009aa4fe4 admin admin] PATH_INFO: `/v3/projects/7c186c3409f94fa5bb7452eee4021eea/users/665ea1968aff4e949cdf07c210e78067/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:27.019386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271101e5-5835-4f8a-8d6f-82d009aa4fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c186c3409f94fa5bb7452eee4021eea, user_id=665ea1968aff4e949cdf07c210e78067, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:27.022005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271101e5-5835-4f8a-8d6f-82d009aa4fe4 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:27.098179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1018/2016] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:26 2022] PUT /identity/v3/projects/7c186c3409f94fa5bb7452eee4021eea/users/665ea1968aff4e949cdf07c210e78067/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:27.103121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0eda2-b3e6-4bfc-a824-4a3f364b7a55 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:27.103411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0eda2-b3e6-4bfc-a824-4a3f364b7a55 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:27.103687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0eda2-b3e6-4bfc-a824-4a3f364b7a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:27.129051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c9e0eda2-b3e6-4bfc-a824-4a3f364b7a55 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:27.130396 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c9e0eda2-b3e6-4bfc-a824-4a3f364b7a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:27.187598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 999/2017] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:27.197353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271101e5-5835-4f8a-8d6f-82d009aa4fe4 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:27.199084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-271101e5-5835-4f8a-8d6f-82d009aa4fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:27.253621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271101e5-5835-4f8a-8d6f-82d009aa4fe4 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:27.257178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36751c3-b8d8-469b-b1f3-1cb4630fd9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:27.257810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36751c3-b8d8-469b-b1f3-1cb4630fd9bc service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:27.258110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36751c3-b8d8-469b-b1f3-1cb4630fd9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:27.258384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36751c3-b8d8-469b-b1f3-1cb4630fd9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:27.267714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36751c3-b8d8-469b-b1f3-1cb4630fd9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:27.269154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36751c3-b8d8-469b-b1f3-1cb4630fd9bc service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:27.278846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1019/2018] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:28.445051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87940b-ec06-4c36-a89c-b33ee55d034a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:28.445540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87940b-ec06-4c36-a89c-b33ee55d034a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:28.445659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87940b-ec06-4c36-a89c-b33ee55d034a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:28.472362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0d87940b-ec06-4c36-a89c-b33ee55d034a None None] MFA Rules not processed for user `665ea1968aff4e949cdf07c210e78067`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:28.473590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0d87940b-ec06-4c36-a89c-b33ee55d034a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:28.535480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1000/2019] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:28.546683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36751c3-b8d8-469b-b1f3-1cb4630fd9bc service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:28.548071 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e36751c3-b8d8-469b-b1f3-1cb4630fd9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:28.602048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36751c3-b8d8-469b-b1f3-1cb4630fd9bc service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:28.606332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f927e-c8d4-4546-ba94-7a4b19f83b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:28.606972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f927e-c8d4-4546-ba94-7a4b19f83b9e service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:28.607248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f927e-c8d4-4546-ba94-7a4b19f83b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:28.607522 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f927e-c8d4-4546-ba94-7a4b19f83b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:28.615971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f927e-c8d4-4546-ba94-7a4b19f83b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:28.617438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f927e-c8d4-4546-ba94-7a4b19f83b9e service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:28.626270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1020/2020] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:31.341426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87940b-ec06-4c36-a89c-b33ee55d034a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:31.345666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0d87940b-ec06-4c36-a89c-b33ee55d034a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:31.358327 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87940b-ec06-4c36-a89c-b33ee55d034a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:31.369195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:31.371746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:31.372187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:31.372624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] PATH_INFO: `/v3/users/6e1dd15f6d2f4fcf8f37da31a1fced29` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:31.375900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1dd15f6d2f4fcf8f37da31a1fced29)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:31.379347 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:31.431465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e23be-907a-4879-8385-4b28b881f159 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:31.431959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e23be-907a-4879-8385-4b28b881f159 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:31.432261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e23be-907a-4879-8385-4b28b881f159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:31.465905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f05e23be-907a-4879-8385-4b28b881f159 None None] MFA Rules not processed for user `665ea1968aff4e949cdf07c210e78067`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:31.468182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f05e23be-907a-4879-8385-4b28b881f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:31.501389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1021/2021] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:31.590594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1dd15f6d2f4fcf8f37da31a1fced29'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:31.591246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1dd15f6d2f4fcf8f37da31a1fced29'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:31.603097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1dd15f6d2f4fcf8f37da31a1fced29'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:31.611004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1dd15f6d2f4fcf8f37da31a1fced29'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:31.632671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1dd15f6d2f4fcf8f37da31a1fced29'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:31.725302 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1001/2022] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:31 2022] DELETE /identity/v3/users/6e1dd15f6d2f4fcf8f37da31a1fced29 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:31.729997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b00eec-e584-4610-8ace-9c64fbc11ca6 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:31.730270 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b00eec-e584-4610-8ace-9c64fbc11ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:31.730548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b00eec-e584-4610-8ace-9c64fbc11ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:31.747917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c4b00eec-e584-4610-8ace-9c64fbc11ca6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:31.749109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c4b00eec-e584-4610-8ace-9c64fbc11ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:31.818564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1022/2023] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:31.832645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:31.834482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:31.893265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bd728-d208-4c19-a70e-f025e9035639 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:31.896970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13285328-1d36-43f7-a2d8-7b38dd5b39a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:31.897622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13285328-1d36-43f7-a2d8-7b38dd5b39a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:31.897908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13285328-1d36-43f7-a2d8-7b38dd5b39a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:31.898281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13285328-1d36-43f7-a2d8-7b38dd5b39a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:31.908213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13285328-1d36-43f7-a2d8-7b38dd5b39a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:31.909640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13285328-1d36-43f7-a2d8-7b38dd5b39a6 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:31.919983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1002/2024] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:32.407210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b00eec-e584-4610-8ace-9c64fbc11ca6 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:32.408620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c4b00eec-e584-4610-8ace-9c64fbc11ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:32.421164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b00eec-e584-4610-8ace-9c64fbc11ca6 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:32.426382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:32.430190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:32.430190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:32.430190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] PATH_INFO: `/v3/projects/de2fe1a196984ea1929aec4bb5e3fcc4` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:32.430190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2fe1a196984ea1929aec4bb5e3fcc4)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:32.432242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:32.570534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2fe1a196984ea1929aec4bb5e3fcc4', 'request_id': 'req-47623152-898c-4cbb-b9fe-64e12cd51b86'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:32.626907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2fe1a196984ea1929aec4bb5e3fcc4', 'request_id': 'req-47623152-898c-4cbb-b9fe-64e12cd51b86'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:32.638866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2fe1a196984ea1929aec4bb5e3fcc4', 'request_id': 'req-47623152-898c-4cbb-b9fe-64e12cd51b86'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:32.644109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] The token cache is being invalidate because project de2fe1a196984ea1929aec4bb5e3fcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:32.644528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:32.645173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:32.646881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1023/2025] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:32 2022] DELETE /identity/v3/projects/de2fe1a196984ea1929aec4bb5e3fcc4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:32.650788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13285328-1d36-43f7-a2d8-7b38dd5b39a6 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:32.660496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13285328-1d36-43f7-a2d8-7b38dd5b39a6 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:32.714327 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:32.715234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:32.715512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:32.715777 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] PATH_INFO: `/v3/users/1f0dc0b8a4874ef087ec676f82123fb6` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:32.716952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0dc0b8a4874ef087ec676f82123fb6)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:32.720232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:32.931184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0dc0b8a4874ef087ec676f82123fb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:32.931755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0dc0b8a4874ef087ec676f82123fb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:32.943479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0dc0b8a4874ef087ec676f82123fb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:32.944183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0dc0b8a4874ef087ec676f82123fb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:32.951649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0dc0b8a4874ef087ec676f82123fb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.016775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1003/2026] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:32 2022] DELETE /identity/v3/users/1f0dc0b8a4874ef087ec676f82123fb6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:33.466833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:33.466833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:33.480199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47623152-898c-4cbb-b9fe-64e12cd51b86 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:33.534634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:33.535517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:33.535798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:33.536068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] PATH_INFO: `/v3/projects/09ba20b2b8504bc3838890f59ae506b9` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:33.537247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ba20b2b8504bc3838890f59ae506b9)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:33.539215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:33.639018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ba20b2b8504bc3838890f59ae506b9', 'request_id': 'req-087d7514-2cdc-4867-bc20-08b3dabb8235'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.712466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ba20b2b8504bc3838890f59ae506b9', 'request_id': 'req-087d7514-2cdc-4867-bc20-08b3dabb8235'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.718501 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ba20b2b8504bc3838890f59ae506b9', 'request_id': 'req-087d7514-2cdc-4867-bc20-08b3dabb8235'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.729312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] The token cache is being invalidate because project 09ba20b2b8504bc3838890f59ae506b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:33.729600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.730302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.731880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1024/2027] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:33 2022] DELETE /identity/v3/projects/09ba20b2b8504bc3838890f59ae506b9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:33.735895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:33.737888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:33.751135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979ca72-fb8c-430f-99fa-fe8972385cde admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:33.807995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:33.809378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:33.809661 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:33.809931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] PATH_INFO: `/v3/users/c5c13dfc98674ee492a61b79937353ec` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:33.811155 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c13dfc98674ee492a61b79937353ec)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:33.813236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:33.966013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c13dfc98674ee492a61b79937353ec'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.966729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c13dfc98674ee492a61b79937353ec'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.978121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c13dfc98674ee492a61b79937353ec'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.978725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c13dfc98674ee492a61b79937353ec'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:33.986156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f802926c-edb6-4c07-903a-e0e0da159ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c13dfc98674ee492a61b79937353ec'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:34.062716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1004/2028] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:33 2022] DELETE /identity/v3/users/c5c13dfc98674ee492a61b79937353ec => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:34.419353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:34.420851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:34.513937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d7514-2cdc-4867-bc20-08b3dabb8235 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:34.573400 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:34.574904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:34.575191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:34.575466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] PATH_INFO: `/v3/projects/6292baea82db4b529333db401a91cb19` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:34.576664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6292baea82db4b529333db401a91cb19)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:34.578643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:34.683149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6292baea82db4b529333db401a91cb19', 'request_id': 'req-2e147fe2-a3fa-4464-a61f-57277d460c1f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:34.803727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6292baea82db4b529333db401a91cb19', 'request_id': 'req-2e147fe2-a3fa-4464-a61f-57277d460c1f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:34.809779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6292baea82db4b529333db401a91cb19', 'request_id': 'req-2e147fe2-a3fa-4464-a61f-57277d460c1f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:34.821853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] The token cache is being invalidate because project 6292baea82db4b529333db401a91cb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:34.822242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:34.822942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2e147fe2-a3fa-4464-a61f-57277d460c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:34.825161 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1025/2029] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:34 2022] DELETE /identity/v3/projects/6292baea82db4b529333db401a91cb19 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:34.830194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad2303-5dba-4337-9218-937197e1fd0b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:34.831103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad2303-5dba-4337-9218-937197e1fd0b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:34.831571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad2303-5dba-4337-9218-937197e1fd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:34.879889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-25ad2303-5dba-4337-9218-937197e1fd0b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:34.881144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-25ad2303-5dba-4337-9218-937197e1fd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:34.941263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1005/2030] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:34.949278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e618678-b13b-4861-8370-44cf20801016 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:34.949567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e618678-b13b-4861-8370-44cf20801016 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:34.949847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e618678-b13b-4861-8370-44cf20801016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:34.969489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9e618678-b13b-4861-8370-44cf20801016 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:34.970777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9e618678-b13b-4861-8370-44cf20801016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:34.984555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1026/2031] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:34.991824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad2303-5dba-4337-9218-937197e1fd0b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:35.001831 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad2303-5dba-4337-9218-937197e1fd0b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:35.007131 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9b6b5-6dd7-4807-8764-17e1531d613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:35.007791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b6b5-6dd7-4807-8764-17e1531d613b admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:35.008078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b6b5-6dd7-4807-8764-17e1531d613b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:35.008381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b6b5-6dd7-4807-8764-17e1531d613b admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:35.009103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9b6b5-6dd7-4807-8764-17e1531d613b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:35.009410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9b6b5-6dd7-4807-8764-17e1531d613b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:35.011148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9b6b5-6dd7-4807-8764-17e1531d613b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:35.024195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1006/2032] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:16:35.028535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e618678-b13b-4861-8370-44cf20801016 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:35.037706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e618678-b13b-4861-8370-44cf20801016 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:35.042671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dee9a-0758-410a-8a96-4ebf6c65132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:35.043307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dee9a-0758-410a-8a96-4ebf6c65132e admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:35.043585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dee9a-0758-410a-8a96-4ebf6c65132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:35.043860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dee9a-0758-410a-8a96-4ebf6c65132e admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:35.045235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dee9a-0758-410a-8a96-4ebf6c65132e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:35.047610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dee9a-0758-410a-8a96-4ebf6c65132e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:35.245123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1027/2033] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:35 2022] POST /identity/v3/projects => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:35.249776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9b6b5-6dd7-4807-8764-17e1531d613b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:35.259687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9b6b5-6dd7-4807-8764-17e1531d613b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:35.317672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf92cd-1e94-4c7d-86ba-e82b69d0e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:35.318287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf92cd-1e94-4c7d-86ba-e82b69d0e43e admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:35.318600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf92cd-1e94-4c7d-86ba-e82b69d0e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:35.318895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf92cd-1e94-4c7d-86ba-e82b69d0e43e admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:35.319871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf92cd-1e94-4c7d-86ba-e82b69d0e43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:35.321787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf92cd-1e94-4c7d-86ba-e82b69d0e43e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:35.461104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1007/2034] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:35 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:35.465382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dee9a-0758-410a-8a96-4ebf6c65132e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:35.475926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dee9a-0758-410a-8a96-4ebf6c65132e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:35.484231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c713b-d9e4-497d-bf31-0079ce9c5996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:35.486906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c713b-d9e4-497d-bf31-0079ce9c5996 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:35.486906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c713b-d9e4-497d-bf31-0079ce9c5996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:35.486906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c713b-d9e4-497d-bf31-0079ce9c5996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:35.486906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c713b-d9e4-497d-bf31-0079ce9c5996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:35.487870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c713b-d9e4-497d-bf31-0079ce9c5996 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:35.498903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1028/2035] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:35.502842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf92cd-1e94-4c7d-86ba-e82b69d0e43e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:35.512740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf92cd-1e94-4c7d-86ba-e82b69d0e43e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:35.517471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025bf5f-2507-4be7-b257-cadd6acbbbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:35.518168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025bf5f-2507-4be7-b257-cadd6acbbbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:35.518456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025bf5f-2507-4be7-b257-cadd6acbbbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:35.518733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025bf5f-2507-4be7-b257-cadd6acbbbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:35.519457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025bf5f-2507-4be7-b257-cadd6acbbbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:35.521055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025bf5f-2507-4be7-b257-cadd6acbbbb2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:35.531049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1008/2036] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:35.535102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c713b-d9e4-497d-bf31-0079ce9c5996 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:35.545751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c713b-d9e4-497d-bf31-0079ce9c5996 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:35.550886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac2ce4-38e0-4853-8d97-deb44fd6f0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:35.551744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac2ce4-38e0-4853-8d97-deb44fd6f0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:35.552019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac2ce4-38e0-4853-8d97-deb44fd6f0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:35.552288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac2ce4-38e0-4853-8d97-deb44fd6f0d1 admin admin] PATH_INFO: `/v3/projects/08b189f79a3a489886e794914b56f9cb/users/a8ae20e4257048b4a5824450564298ad/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:35.567033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac2ce4-38e0-4853-8d97-deb44fd6f0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b189f79a3a489886e794914b56f9cb, user_id=a8ae20e4257048b4a5824450564298ad, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:35.570075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac2ce4-38e0-4853-8d97-deb44fd6f0d1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:35.652727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1029/2037] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:35 2022] PUT /identity/v3/projects/08b189f79a3a489886e794914b56f9cb/users/a8ae20e4257048b4a5824450564298ad/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:35.661542 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373fca-e113-48ec-8759-e82eafda5c3f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:35.661836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373fca-e113-48ec-8759-e82eafda5c3f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:35.662147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c373fca-e113-48ec-8759-e82eafda5c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:35.689995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5c373fca-e113-48ec-8759-e82eafda5c3f None None] MFA Rules not processed for user `a8ae20e4257048b4a5824450564298ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:35.691254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5c373fca-e113-48ec-8759-e82eafda5c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:35.770097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1009/2038] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:35.779010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac2ce4-38e0-4853-8d97-deb44fd6f0d1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:35.781063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-18ac2ce4-38e0-4853-8d97-deb44fd6f0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:35.865607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac2ce4-38e0-4853-8d97-deb44fd6f0d1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:35.869277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c796f-dac9-420e-bc47-deb34bb0247a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9237b353da546989b399ee9702d1bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:35.869918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c796f-dac9-420e-bc47-deb34bb0247a service glance] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:35.870314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c796f-dac9-420e-bc47-deb34bb0247a service glance] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:35.870787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c796f-dac9-420e-bc47-deb34bb0247a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:35.879226 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c796f-dac9-420e-bc47-deb34bb0247a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:35.880672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c796f-dac9-420e-bc47-deb34bb0247a service glance] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:35.890563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1030/2039] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:38.808411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373fca-e113-48ec-8759-e82eafda5c3f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:38.810004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5c373fca-e113-48ec-8759-e82eafda5c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:38.885756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c373fca-e113-48ec-8759-e82eafda5c3f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:38.891014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:38.891888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:38.892488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:38.893140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] PATH_INFO: `/v3/users/e8bedfeb9a6d48508f6a200d6a5e585b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:38.894950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bedfeb9a6d48508f6a200d6a5e585b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:38.896873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:39.063580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bedfeb9a6d48508f6a200d6a5e585b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:39.064312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bedfeb9a6d48508f6a200d6a5e585b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:39.077189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bedfeb9a6d48508f6a200d6a5e585b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:39.078102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bedfeb9a6d48508f6a200d6a5e585b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:39.086694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bedfeb9a6d48508f6a200d6a5e585b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:39.171070 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1010/2040] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:38 2022] DELETE /identity/v3/users/e8bedfeb9a6d48508f6a200d6a5e585b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:39.175953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88f927-c629-4c5a-a773-5801b83900a9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:39.176475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88f927-c629-4c5a-a773-5801b83900a9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:39.176568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88f927-c629-4c5a-a773-5801b83900a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:39.196437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-5b88f927-c629-4c5a-a773-5801b83900a9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:39.198949 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5b88f927-c629-4c5a-a773-5801b83900a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:39.262462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1031/2041] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:39.272293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:39.273682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:39.352574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370dd5d-4087-4053-933f-036b98d0020e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:39.356340 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e79c-c878-417c-95a3-4309c0dc82ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:39.356987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e79c-c878-417c-95a3-4309c0dc82ca service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:39.357268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e79c-c878-417c-95a3-4309c0dc82ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:39.357542 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e79c-c878-417c-95a3-4309c0dc82ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:39.366621 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046e79c-c878-417c-95a3-4309c0dc82ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:39.368086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046e79c-c878-417c-95a3-4309c0dc82ca service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:39.377629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1011/2042] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:39.818882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88f927-c629-4c5a-a773-5801b83900a9 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:39.821035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5b88f927-c629-4c5a-a773-5801b83900a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:39.845686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88f927-c629-4c5a-a773-5801b83900a9 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:39.853202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:39.855967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:39.856374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:39.857342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] PATH_INFO: `/v3/projects/a037e2fa528746b5bb0180cfee272a87` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:39.860945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a037e2fa528746b5bb0180cfee272a87)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:39.863913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:40.023636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a037e2fa528746b5bb0180cfee272a87', 'request_id': 'req-723a9d9b-fc94-4b65-826e-a8515610d1c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.112357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a037e2fa528746b5bb0180cfee272a87', 'request_id': 'req-723a9d9b-fc94-4b65-826e-a8515610d1c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.120973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a037e2fa528746b5bb0180cfee272a87', 'request_id': 'req-723a9d9b-fc94-4b65-826e-a8515610d1c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.132328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] The token cache is being invalidate because project a037e2fa528746b5bb0180cfee272a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:40.132615 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.133327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.135215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1032/2043] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:39 2022] DELETE /identity/v3/projects/a037e2fa528746b5bb0180cfee272a87 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:40.139798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e79c-c878-417c-95a3-4309c0dc82ca service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:40.149490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e79c-c878-417c-95a3-4309c0dc82ca service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:40.206454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:40.207414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:40.207774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:40.208153 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] PATH_INFO: `/v3/users/552ce1bf09fa47a292a9596d096acf09` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:40.209456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=552ce1bf09fa47a292a9596d096acf09)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:40.211490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:40.405325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552ce1bf09fa47a292a9596d096acf09'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.405968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552ce1bf09fa47a292a9596d096acf09'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.418420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552ce1bf09fa47a292a9596d096acf09'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.427265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552ce1bf09fa47a292a9596d096acf09'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.438644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:40.440770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:40.442143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552ce1bf09fa47a292a9596d096acf09'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.454627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a9d9b-fc94-4b65-826e-a8515610d1c6 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:40.459294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:40.460155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:40.460443 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:40.460718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] PATH_INFO: `/v3/users/22de22e8d5964f29b577af216eb3cdd9` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:40.461907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22de22e8d5964f29b577af216eb3cdd9)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:40.464107 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:40.512752 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1012/2044] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:40 2022] DELETE /identity/v3/users/552ce1bf09fa47a292a9596d096acf09 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:40.685714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22de22e8d5964f29b577af216eb3cdd9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.686372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22de22e8d5964f29b577af216eb3cdd9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.686979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22de22e8d5964f29b577af216eb3cdd9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.699202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22de22e8d5964f29b577af216eb3cdd9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.709968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22de22e8d5964f29b577af216eb3cdd9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:40.764807 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1033/2045] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:40 2022] DELETE /identity/v3/users/22de22e8d5964f29b577af216eb3cdd9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:40.924114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:40.925786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:41.000159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230bff5-3767-4108-a442-ef9f809affd9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.030208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.032531 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:41.084806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.085748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.085979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.086339 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] PATH_INFO: `/v3/projects/5de78ab6a7a64a53a7e7b1eb86fb9e16` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.087615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de78ab6a7a64a53a7e7b1eb86fb9e16)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.090286 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.146685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6e589-7651-4197-9973-bd3d966bf132 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.158530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.159462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.159912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.160700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] PATH_INFO: `/v3/projects/bb76045fec614358bd2bb89018436943` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.167819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb76045fec614358bd2bb89018436943)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.170036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.200136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de78ab6a7a64a53a7e7b1eb86fb9e16', 'request_id': 'req-44838bbd-65b1-42cb-917c-664188e87173'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.207445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de78ab6a7a64a53a7e7b1eb86fb9e16', 'request_id': 'req-44838bbd-65b1-42cb-917c-664188e87173'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.224023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de78ab6a7a64a53a7e7b1eb86fb9e16', 'request_id': 'req-44838bbd-65b1-42cb-917c-664188e87173'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.303743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb76045fec614358bd2bb89018436943', 'request_id': 'req-94825deb-c397-411b-9c23-a526bd6a6839'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.328652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] The token cache is being invalidate because project 5de78ab6a7a64a53a7e7b1eb86fb9e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:41.328874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.329497 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-44838bbd-65b1-42cb-917c-664188e87173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.331091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1013/2046] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:40 2022] DELETE /identity/v3/projects/5de78ab6a7a64a53a7e7b1eb86fb9e16 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:41.335716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584521de-809b-4c30-9b74-c75734711d85 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.336005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584521de-809b-4c30-9b74-c75734711d85 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.336280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584521de-809b-4c30-9b74-c75734711d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.356962 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-584521de-809b-4c30-9b74-c75734711d85 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:41.358182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-584521de-809b-4c30-9b74-c75734711d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:41.405016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb76045fec614358bd2bb89018436943', 'request_id': 'req-94825deb-c397-411b-9c23-a526bd6a6839'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.411844 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb76045fec614358bd2bb89018436943', 'request_id': 'req-94825deb-c397-411b-9c23-a526bd6a6839'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.423661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] The token cache is being invalidate because project bb76045fec614358bd2bb89018436943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:41.424700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.425340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-94825deb-c397-411b-9c23-a526bd6a6839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:41.427196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1034/2047] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:41 2022] DELETE /identity/v3/projects/bb76045fec614358bd2bb89018436943 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:41.432908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1014/2048] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:41.433025 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534d3f-f590-4856-b22a-3ed575b6a002 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.433465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534d3f-f590-4856-b22a-3ed575b6a002 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.433750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534d3f-f590-4856-b22a-3ed575b6a002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.441244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c0480-33ec-47ea-a71a-8d223413d387 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.441542 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c0480-33ec-47ea-a71a-8d223413d387 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.441936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c0480-33ec-47ea-a71a-8d223413d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.454657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-1a534d3f-f590-4856-b22a-3ed575b6a002 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:41.455998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1a534d3f-f590-4856-b22a-3ed575b6a002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:41.464835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1035/2049] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:41.465322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-950c0480-33ec-47ea-a71a-8d223413d387 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:41.467031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-950c0480-33ec-47ea-a71a-8d223413d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:41.473537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d1408-3793-459a-b008-513f7a6c21d8 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.473537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d1408-3793-459a-b008-513f7a6c21d8 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.473537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d1408-3793-459a-b008-513f7a6c21d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.481606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1015/2050] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:41.486375 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c0480-33ec-47ea-a71a-8d223413d387 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.495741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f95d1408-3793-459a-b008-513f7a6c21d8 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:41.495741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f95d1408-3793-459a-b008-513f7a6c21d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:41.495995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c0480-33ec-47ea-a71a-8d223413d387 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.500750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac166328-82e5-4a76-8be9-65aca89cbabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.501629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac166328-82e5-4a76-8be9-65aca89cbabb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.502184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac166328-82e5-4a76-8be9-65aca89cbabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.502734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac166328-82e5-4a76-8be9-65aca89cbabb admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.503603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac166328-82e5-4a76-8be9-65aca89cbabb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:41.504066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac166328-82e5-4a76-8be9-65aca89cbabb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.504470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1036/2051] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:41.506098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac166328-82e5-4a76-8be9-65aca89cbabb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.511592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d1408-3793-459a-b008-513f7a6c21d8 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.521057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1016/2052] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:16:41.524039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d1408-3793-459a-b008-513f7a6c21d8 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.526884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66536-b218-4c80-8ed8-a5ded84dba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.527542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66536-b218-4c80-8ed8-a5ded84dba73 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.527826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66536-b218-4c80-8ed8-a5ded84dba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.528100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f66536-b218-4c80-8ed8-a5ded84dba73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.528193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac166328-82e5-4a76-8be9-65aca89cbabb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.528921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f66536-b218-4c80-8ed8-a5ded84dba73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:41.529191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f66536-b218-4c80-8ed8-a5ded84dba73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.530867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f66536-b218-4c80-8ed8-a5ded84dba73 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.537966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac166328-82e5-4a76-8be9-65aca89cbabb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.543398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1037/2053] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:16:41.547432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66536-b218-4c80-8ed8-a5ded84dba73 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.552859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2ef8-733f-468d-b020-9cf6322b2476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.552859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2ef8-733f-468d-b020-9cf6322b2476 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.552859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2ef8-733f-468d-b020-9cf6322b2476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.552859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa2ef8-733f-468d-b020-9cf6322b2476 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.553233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa2ef8-733f-468d-b020-9cf6322b2476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.553233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa2ef8-733f-468d-b020-9cf6322b2476 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.564370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f66536-b218-4c80-8ed8-a5ded84dba73 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.570350 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2babd21-03da-4cd7-83ba-a5be0f251047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.571006 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2babd21-03da-4cd7-83ba-a5be0f251047 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.571292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2babd21-03da-4cd7-83ba-a5be0f251047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.571567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2babd21-03da-4cd7-83ba-a5be0f251047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.572259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2babd21-03da-4cd7-83ba-a5be0f251047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.574730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2babd21-03da-4cd7-83ba-a5be0f251047 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.632690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1017/2054] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:41 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:41.634203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2ef8-733f-468d-b020-9cf6322b2476 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.646330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1038/2055] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:41 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:41.650793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2babd21-03da-4cd7-83ba-a5be0f251047 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.711906 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa2ef8-733f-468d-b020-9cf6322b2476 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.732662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2babd21-03da-4cd7-83ba-a5be0f251047 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.738236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96572a-21ee-42f3-984e-d639e044bcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.738916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96572a-21ee-42f3-984e-d639e044bcea admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.739547 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96572a-21ee-42f3-984e-d639e044bcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.739827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96572a-21ee-42f3-984e-d639e044bcea admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.740734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96572a-21ee-42f3-984e-d639e044bcea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.743076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96572a-21ee-42f3-984e-d639e044bcea admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.774017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5eff4-2b34-443b-814e-2b60fa4abcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.774723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5eff4-2b34-443b-814e-2b60fa4abcd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.775026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5eff4-2b34-443b-814e-2b60fa4abcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.775287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5eff4-2b34-443b-814e-2b60fa4abcd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.775977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5eff4-2b34-443b-814e-2b60fa4abcd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.777937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5eff4-2b34-443b-814e-2b60fa4abcd5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.844789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1039/2056] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:41 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:41.852398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96572a-21ee-42f3-984e-d639e044bcea admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.862046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96572a-21ee-42f3-984e-d639e044bcea admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.866702 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a988a-5ef2-43ee-9f8a-a7ffbfc483ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.867329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a988a-5ef2-43ee-9f8a-a7ffbfc483ca admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.867648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a988a-5ef2-43ee-9f8a-a7ffbfc483ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.867889 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a988a-5ef2-43ee-9f8a-a7ffbfc483ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.868604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a988a-5ef2-43ee-9f8a-a7ffbfc483ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.870740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a988a-5ef2-43ee-9f8a-a7ffbfc483ca admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.874498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1018/2057] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:41 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:41.878245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5eff4-2b34-443b-814e-2b60fa4abcd5 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.880560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1040/2058] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:41.884182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a988a-5ef2-43ee-9f8a-a7ffbfc483ca admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.888623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5eff4-2b34-443b-814e-2b60fa4abcd5 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.893547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16bf71-f139-4097-bef9-e01d3496ebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.894241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16bf71-f139-4097-bef9-e01d3496ebbe admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.894497 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a988a-5ef2-43ee-9f8a-a7ffbfc483ca admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.894621 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16bf71-f139-4097-bef9-e01d3496ebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.894782 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16bf71-f139-4097-bef9-e01d3496ebbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.895518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16bf71-f139-4097-bef9-e01d3496ebbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.897105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16bf71-f139-4097-bef9-e01d3496ebbe admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.899514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118d35-8a9c-4b84-af17-7198110e32aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.900151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118d35-8a9c-4b84-af17-7198110e32aa admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.900430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118d35-8a9c-4b84-af17-7198110e32aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.900701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118d35-8a9c-4b84-af17-7198110e32aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.901522 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10118d35-8a9c-4b84-af17-7198110e32aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.903208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10118d35-8a9c-4b84-af17-7198110e32aa admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.907121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1019/2059] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:41.911057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16bf71-f139-4097-bef9-e01d3496ebbe admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.913831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1041/2060] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:41.918040 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118d35-8a9c-4b84-af17-7198110e32aa admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.923888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16bf71-f139-4097-bef9-e01d3496ebbe admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.927433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118d35-8a9c-4b84-af17-7198110e32aa admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.929818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043792f-a60e-4a47-be15-807c745a5da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.929818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043792f-a60e-4a47-be15-807c745a5da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.930009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043792f-a60e-4a47-be15-807c745a5da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.930194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043792f-a60e-4a47-be15-807c745a5da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.930931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043792f-a60e-4a47-be15-807c745a5da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.932920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589b7ed-3da7-4823-a709-f367ef410a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.933053 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043792f-a60e-4a47-be15-807c745a5da6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.933760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b7ed-3da7-4823-a709-f367ef410a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.934039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b7ed-3da7-4823-a709-f367ef410a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.934340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589b7ed-3da7-4823-a709-f367ef410a48 admin admin] PATH_INFO: `/v3/projects/73c8a191b8134f3388fb7ec5a206bbd7/users/6b541636e0c74f0ab50614a358949921/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.943821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1020/2061] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:41.956220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043792f-a60e-4a47-be15-807c745a5da6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:41.956368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589b7ed-3da7-4823-a709-f367ef410a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c8a191b8134f3388fb7ec5a206bbd7, user_id=6b541636e0c74f0ab50614a358949921, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.956368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589b7ed-3da7-4823-a709-f367ef410a48 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:41.958159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043792f-a60e-4a47-be15-807c745a5da6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:41.963237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343e8f3-1768-4b87-bda1-feec598c8def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:41.964325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343e8f3-1768-4b87-bda1-feec598c8def admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:41.964601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343e8f3-1768-4b87-bda1-feec598c8def admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:41.964894 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343e8f3-1768-4b87-bda1-feec598c8def admin admin] PATH_INFO: `/v3/projects/7c9ce6a019394e648f7a19ffe64f5889/users/59881303bacf45b2915597b6f0431699/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:41.981918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343e8f3-1768-4b87-bda1-feec598c8def admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9ce6a019394e648f7a19ffe64f5889, user_id=59881303bacf45b2915597b6f0431699, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:41.985075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343e8f3-1768-4b87-bda1-feec598c8def admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:42.056483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1042/2062] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:41 2022] PUT /identity/v3/projects/73c8a191b8134f3388fb7ec5a206bbd7/users/6b541636e0c74f0ab50614a358949921/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:42.068641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedc7aa-8cd7-43c0-b9e6-9016eb2b595f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.068952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedc7aa-8cd7-43c0-b9e6-9016eb2b595f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.069488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedc7aa-8cd7-43c0-b9e6-9016eb2b595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.090678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1021/2063] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:41 2022] PUT /identity/v3/projects/7c9ce6a019394e648f7a19ffe64f5889/users/59881303bacf45b2915597b6f0431699/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:42.100688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-1aedc7aa-8cd7-43c0-b9e6-9016eb2b595f None None] MFA Rules not processed for user `6b541636e0c74f0ab50614a358949921`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:42.101902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1aedc7aa-8cd7-43c0-b9e6-9016eb2b595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:42.105536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e63c-bbdc-41c6-aa27-0001ae85eac6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.106261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e63c-bbdc-41c6-aa27-0001ae85eac6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.107065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7e63c-bbdc-41c6-aa27-0001ae85eac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.134196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-12d7e63c-bbdc-41c6-aa27-0001ae85eac6 None None] MFA Rules not processed for user `59881303bacf45b2915597b6f0431699`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:42.135413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-12d7e63c-bbdc-41c6-aa27-0001ae85eac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:42.168395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1043/2064] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:42.180015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedc7aa-8cd7-43c0-b9e6-9016eb2b595f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:42.181386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1aedc7aa-8cd7-43c0-b9e6-9016eb2b595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:42.201543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1022/2065] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:42.206085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7e63c-bbdc-41c6-aa27-0001ae85eac6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:42.243122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedc7aa-8cd7-43c0-b9e6-9016eb2b595f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:42.243644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69f93e-df99-484a-a8f4-b6e289c93afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:42.243943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69f93e-df99-484a-a8f4-b6e289c93afb service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.244222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69f93e-df99-484a-a8f4-b6e289c93afb service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.244515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69f93e-df99-484a-a8f4-b6e289c93afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.255184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69f93e-df99-484a-a8f4-b6e289c93afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:42.256457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69f93e-df99-484a-a8f4-b6e289c93afb service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:42.266332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1044/2066] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:16:42.273734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7e63c-bbdc-41c6-aa27-0001ae85eac6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:42.278348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed345d79-5754-4b0f-b034-53eb1cc495e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:42.284069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed345d79-5754-4b0f-b034-53eb1cc495e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.284069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed345d79-5754-4b0f-b034-53eb1cc495e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.284069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed345d79-5754-4b0f-b034-53eb1cc495e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.284069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed345d79-5754-4b0f-b034-53eb1cc495e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:42.284069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed345d79-5754-4b0f-b034-53eb1cc495e1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:42.364026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1023/2067] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:42 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:42.370557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69f93e-df99-484a-a8f4-b6e289c93afb service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:42.378980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69f93e-df99-484a-a8f4-b6e289c93afb service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:42.442591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e32406-7533-483b-8b1c-7a6226c8d9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:42.443248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32406-7533-483b-8b1c-7a6226c8d9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.443538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32406-7533-483b-8b1c-7a6226c8d9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.443809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32406-7533-483b-8b1c-7a6226c8d9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.444844 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e32406-7533-483b-8b1c-7a6226c8d9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:42.446825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e32406-7533-483b-8b1c-7a6226c8d9e1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:42.555429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1045/2068] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:42 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:42.562273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed345d79-5754-4b0f-b034-53eb1cc495e1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:42.574825 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed345d79-5754-4b0f-b034-53eb1cc495e1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:42.579856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799bc0c-671d-45b5-9cc9-0e2c422f6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:42.580644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799bc0c-671d-45b5-9cc9-0e2c422f6813 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.580792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799bc0c-671d-45b5-9cc9-0e2c422f6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.581067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799bc0c-671d-45b5-9cc9-0e2c422f6813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.581849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799bc0c-671d-45b5-9cc9-0e2c422f6813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:42.583421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799bc0c-671d-45b5-9cc9-0e2c422f6813 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:42.595326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1024/2069] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:42.602024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e32406-7533-483b-8b1c-7a6226c8d9e1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:42.612533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e32406-7533-483b-8b1c-7a6226c8d9e1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:42.617470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dacab-4606-498b-bb99-44f784b06e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:42.618394 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dacab-4606-498b-bb99-44f784b06e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.618664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dacab-4606-498b-bb99-44f784b06e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.618938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dacab-4606-498b-bb99-44f784b06e4c admin admin] PATH_INFO: `/v3/projects/831e4324f7274957aabbc36dd37ac2d7/users/d5afe1bbe7db4921aace2bc40c94e252/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.630225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799bc0c-671d-45b5-9cc9-0e2c422f6813 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:42.632225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5799bc0c-671d-45b5-9cc9-0e2c422f6813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:42.637141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dacab-4606-498b-bb99-44f784b06e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=831e4324f7274957aabbc36dd37ac2d7, user_id=d5afe1bbe7db4921aace2bc40c94e252, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:42.639986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dacab-4606-498b-bb99-44f784b06e4c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:42.645747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799bc0c-671d-45b5-9cc9-0e2c422f6813 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:42.650411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:42.653555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.653555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.653555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] PATH_INFO: `/v3/users/333cf6ad4eed46af9d61859f6e72dc25` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.653555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333cf6ad4eed46af9d61859f6e72dc25)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:42.655124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:42.708484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1046/2070] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:42 2022] PUT /identity/v3/projects/831e4324f7274957aabbc36dd37ac2d7/users/d5afe1bbe7db4921aace2bc40c94e252/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:42.713548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dacab-4606-498b-bb99-44f784b06e4c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:42.772076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dacab-4606-498b-bb99-44f784b06e4c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:42.776629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e06bb0-710c-4496-8575-3b03a280005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:42.777287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e06bb0-710c-4496-8575-3b03a280005c admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.777571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e06bb0-710c-4496-8575-3b03a280005c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.777843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e06bb0-710c-4496-8575-3b03a280005c admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.778591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e06bb0-710c-4496-8575-3b03a280005c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:42.780174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e06bb0-710c-4496-8575-3b03a280005c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:42.789540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1047/2071] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:42.793731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e06bb0-710c-4496-8575-3b03a280005c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:42.803080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e06bb0-710c-4496-8575-3b03a280005c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:42.808440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d4af3-26fb-4683-8331-6d5f5046d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:42.809390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4af3-26fb-4683-8331-6d5f5046d460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.809683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4af3-26fb-4683-8331-6d5f5046d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.809945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4af3-26fb-4683-8331-6d5f5046d460 admin admin] PATH_INFO: `/v3/projects/831e4324f7274957aabbc36dd37ac2d7/users/d5afe1bbe7db4921aace2bc40c94e252/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.812279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d4af3-26fb-4683-8331-6d5f5046d460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=831e4324f7274957aabbc36dd37ac2d7, user_id=d5afe1bbe7db4921aace2bc40c94e252, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:42.815452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d4af3-26fb-4683-8331-6d5f5046d460 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:42.829586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1048/2072] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:42 2022] PUT /identity/v3/projects/831e4324f7274957aabbc36dd37ac2d7/users/d5afe1bbe7db4921aace2bc40c94e252/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:42.840528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c1401-c2eb-4f49-aef5-e6ff0b0ef346 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.840844 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c1401-c2eb-4f49-aef5-e6ff0b0ef346 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:42.841121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c1401-c2eb-4f49-aef5-e6ff0b0ef346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:42.863665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333cf6ad4eed46af9d61859f6e72dc25'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:42.864325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333cf6ad4eed46af9d61859f6e72dc25'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:42.867919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a06c1401-c2eb-4f49-aef5-e6ff0b0ef346 None None] MFA Rules not processed for user `d5afe1bbe7db4921aace2bc40c94e252`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:42.869122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a06c1401-c2eb-4f49-aef5-e6ff0b0ef346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:42.879853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333cf6ad4eed46af9d61859f6e72dc25'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:42.880708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333cf6ad4eed46af9d61859f6e72dc25'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:42.889014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6a314607-d726-4a22-a44b-3525d0d6ffe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333cf6ad4eed46af9d61859f6e72dc25'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:42.948601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1049/2073] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:42.972535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c1401-c2eb-4f49-aef5-e6ff0b0ef346 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:42.974041 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a06c1401-c2eb-4f49-aef5-e6ff0b0ef346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:42.994083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1025/2074] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:42 2022] DELETE /identity/v3/users/333cf6ad4eed46af9d61859f6e72dc25 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:42.999229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc39769-ed02-4ed2-a2a5-44f32847e911 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:42.999725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc39769-ed02-4ed2-a2a5-44f32847e911 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:43.000181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc39769-ed02-4ed2-a2a5-44f32847e911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:43.025211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bcc39769-ed02-4ed2-a2a5-44f32847e911 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:43.026755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bcc39769-ed02-4ed2-a2a5-44f32847e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:43.038802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c1401-c2eb-4f49-aef5-e6ff0b0ef346 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:43.120840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1026/2075] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:43.130832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2c237-bff5-40ae-aaa6-4217e8382dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:43.131443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc39769-ed02-4ed2-a2a5-44f32847e911 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:43.131567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2c237-bff5-40ae-aaa6-4217e8382dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:43.131781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2c237-bff5-40ae-aaa6-4217e8382dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:43.132051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2c237-bff5-40ae-aaa6-4217e8382dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:43.133626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bcc39769-ed02-4ed2-a2a5-44f32847e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:43.188792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc39769-ed02-4ed2-a2a5-44f32847e911 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:43.190298 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2c237-bff5-40ae-aaa6-4217e8382dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:43.191729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2c237-bff5-40ae-aaa6-4217e8382dc6 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:43.192751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9478017-11eb-49d5-860f-b2728e7e28a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:43.193399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9478017-11eb-49d5-860f-b2728e7e28a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:43.193677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9478017-11eb-49d5-860f-b2728e7e28a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:43.193955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9478017-11eb-49d5-860f-b2728e7e28a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:43.202579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1050/2076] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:16:43.203842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9478017-11eb-49d5-860f-b2728e7e28a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:43.205366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9478017-11eb-49d5-860f-b2728e7e28a8 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:43.216731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1027/2077] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:16:43.231100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2c237-bff5-40ae-aaa6-4217e8382dc6 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:43.233030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-32d2c237-bff5-40ae-aaa6-4217e8382dc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:43.247545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2c237-bff5-40ae-aaa6-4217e8382dc6 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:43.252974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:43.253891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:43.254209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:43.254620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] PATH_INFO: `/v3/users/59881303bacf45b2915597b6f0431699` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:43.255952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59881303bacf45b2915597b6f0431699)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:43.258131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:43.577820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59881303bacf45b2915597b6f0431699'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:43.579283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59881303bacf45b2915597b6f0431699'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:43.580117 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59881303bacf45b2915597b6f0431699'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:43.595191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59881303bacf45b2915597b6f0431699'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:43.602103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59881303bacf45b2915597b6f0431699'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:43.684094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1051/2078] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:43 2022] DELETE /identity/v3/users/59881303bacf45b2915597b6f0431699 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:43.688698 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f9f75-5e2e-43f6-97a0-1c0c7863198c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:43.688999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f9f75-5e2e-43f6-97a0-1c0c7863198c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:43.689273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f9f75-5e2e-43f6-97a0-1c0c7863198c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:43.708529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a75f9f75-5e2e-43f6-97a0-1c0c7863198c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:43.710479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a75f9f75-5e2e-43f6-97a0-1c0c7863198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:43.766623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:43.768218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:43.771468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1028/2079] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:43.779653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f9f75-5e2e-43f6-97a0-1c0c7863198c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:43.780932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a75f9f75-5e2e-43f6-97a0-1c0c7863198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:43.792335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b37a07-fb15-45ac-ad10-33143980c42b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:43.797040 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:43.798150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:43.798432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:43.798705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] PATH_INFO: `/v3/projects/b5d58755d6414abca0c50beb7325f8a6` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:43.799904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d58755d6414abca0c50beb7325f8a6)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:43.801847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:43.840077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f9f75-5e2e-43f6-97a0-1c0c7863198c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:43.843692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0336d83-fbf9-4264-b771-a89333608ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:43.844312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336d83-fbf9-4264-b771-a89333608ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:43.844596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336d83-fbf9-4264-b771-a89333608ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:43.844874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336d83-fbf9-4264-b771-a89333608ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:43.853736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0336d83-fbf9-4264-b771-a89333608ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:43.855228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0336d83-fbf9-4264-b771-a89333608ab1 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:43.864738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1029/2080] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:16:43.932412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d58755d6414abca0c50beb7325f8a6', 'request_id': 'req-148bc02b-6b74-439b-98aa-e7c7e0a5756c'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:43.997336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d58755d6414abca0c50beb7325f8a6', 'request_id': 'req-148bc02b-6b74-439b-98aa-e7c7e0a5756c'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.004952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d58755d6414abca0c50beb7325f8a6', 'request_id': 'req-148bc02b-6b74-439b-98aa-e7c7e0a5756c'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.016923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] The token cache is being invalidate because project b5d58755d6414abca0c50beb7325f8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:44.017206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.017869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-148bc02b-6b74-439b-98aa-e7c7e0a5756c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.019457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1052/2081] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:43 2022] DELETE /identity/v3/projects/b5d58755d6414abca0c50beb7325f8a6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:44.024387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ba43a-4586-4907-a75e-4a9e618bb367 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.024517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ba43a-4586-4907-a75e-4a9e618bb367 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.024734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ba43a-4586-4907-a75e-4a9e618bb367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.043449 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-717ba43a-4586-4907-a75e-4a9e618bb367 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:44.044643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-717ba43a-4586-4907-a75e-4a9e618bb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:44.155660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1030/2082] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:44.156373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b0c7-2c9d-4faf-96b8-834d179a1a7d None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.156661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b0c7-2c9d-4faf-96b8-834d179a1a7d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.156936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b0c7-2c9d-4faf-96b8-834d179a1a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.178234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2e58b0c7-2c9d-4faf-96b8-834d179a1a7d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:44.180024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2e58b0c7-2c9d-4faf-96b8-834d179a1a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:44.194724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ba43a-4586-4907-a75e-4a9e618bb367 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:44.195463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1053/2083] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:44.215102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ba43a-4586-4907-a75e-4a9e618bb367 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:44.223452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:44.225729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.226082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.226421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.228168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:44.228168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:44.231281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:44.259323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1031/2084] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:16:44.264425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58b0c7-2c9d-4faf-96b8-834d179a1a7d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:44.276009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58b0c7-2c9d-4faf-96b8-834d179a1a7d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:44.288266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e0758-fb14-40e5-af34-2cb1952fe384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:44.289624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e0758-fb14-40e5-af34-2cb1952fe384 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.290087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e0758-fb14-40e5-af34-2cb1952fe384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.290537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e0758-fb14-40e5-af34-2cb1952fe384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.291398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e0758-fb14-40e5-af34-2cb1952fe384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:44.293499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e0758-fb14-40e5-af34-2cb1952fe384 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:44.372532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:44.374967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:44.393529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4ebb2-894d-4da9-9e71-4d49c1593909 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:44.401255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1054/2085] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:44 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:44.405470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e0758-fb14-40e5-af34-2cb1952fe384 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:44.406467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:44.407340 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.407614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.407883 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] PATH_INFO: `/v3/projects/7c9ce6a019394e648f7a19ffe64f5889` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.412726 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9ce6a019394e648f7a19ffe64f5889)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:44.414718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:44.471263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e0758-fb14-40e5-af34-2cb1952fe384 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:44.476058 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680582fa-b5b4-44dc-9cd4-ed6db2b8afc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:44.476865 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680582fa-b5b4-44dc-9cd4-ed6db2b8afc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.477152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680582fa-b5b4-44dc-9cd4-ed6db2b8afc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.477425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680582fa-b5b4-44dc-9cd4-ed6db2b8afc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.478167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680582fa-b5b4-44dc-9cd4-ed6db2b8afc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:44.480679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680582fa-b5b4-44dc-9cd4-ed6db2b8afc0 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:44.529425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9ce6a019394e648f7a19ffe64f5889', 'request_id': 'req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.537281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9ce6a019394e648f7a19ffe64f5889', 'request_id': 'req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.543411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9ce6a019394e648f7a19ffe64f5889', 'request_id': 'req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.581791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1055/2086] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:44 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:44.585917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680582fa-b5b4-44dc-9cd4-ed6db2b8afc0 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:44.595490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680582fa-b5b4-44dc-9cd4-ed6db2b8afc0 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:44.662796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924576a-b1ae-4964-a4b2-45df79e649e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:44.663546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924576a-b1ae-4964-a4b2-45df79e649e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.665220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924576a-b1ae-4964-a4b2-45df79e649e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.666197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924576a-b1ae-4964-a4b2-45df79e649e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.670320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924576a-b1ae-4964-a4b2-45df79e649e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:44.670320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924576a-b1ae-4964-a4b2-45df79e649e9 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:44.680891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1056/2087] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:44.685192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924576a-b1ae-4964-a4b2-45df79e649e9 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:44.696499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] The token cache is being invalidate because project 7c9ce6a019394e648f7a19ffe64f5889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:44.696784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.697451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.699291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1032/2088] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:44 2022] DELETE /identity/v3/projects/7c9ce6a019394e648f7a19ffe64f5889 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:44.703592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:44.705184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:44.714082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924576a-b1ae-4964-a4b2-45df79e649e9 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:44.719789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96d9d-4916-442b-9d7f-9d2ed87cbe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:44.720881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96d9d-4916-442b-9d7f-9d2ed87cbe00 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.721171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96d9d-4916-442b-9d7f-9d2ed87cbe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.721451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96d9d-4916-442b-9d7f-9d2ed87cbe00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.722343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c96d9d-4916-442b-9d7f-9d2ed87cbe00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:44.723996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c96d9d-4916-442b-9d7f-9d2ed87cbe00 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:44.726679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eddf5-4f87-4b55-ac8f-a172d2493ecf admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:44.737314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1057/2089] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:44.741201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96d9d-4916-442b-9d7f-9d2ed87cbe00 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:44.743764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-32c96d9d-4916-442b-9d7f-9d2ed87cbe00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:44.745978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:44.748263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.748558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.748836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] PATH_INFO: `/v3/users/d5afe1bbe7db4921aace2bc40c94e252` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.750664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5afe1bbe7db4921aace2bc40c94e252)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:44.755050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:44.765203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96d9d-4916-442b-9d7f-9d2ed87cbe00 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:44.775294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b54b5-4ecd-417d-92e9-56f3b6d9f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:44.776721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b54b5-4ecd-417d-92e9-56f3b6d9f125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.777023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b54b5-4ecd-417d-92e9-56f3b6d9f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.777300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b54b5-4ecd-417d-92e9-56f3b6d9f125 admin admin] PATH_INFO: `/v3/projects/393a617f4b8d41ada02847c58a923908/users/3a6c7b5b1df343b88798527bedd74112/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.821165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b54b5-4ecd-417d-92e9-56f3b6d9f125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393a617f4b8d41ada02847c58a923908, user_id=3a6c7b5b1df343b88798527bedd74112, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:44.821165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b54b5-4ecd-417d-92e9-56f3b6d9f125 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:44.931304 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1058/2090] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:44 2022] PUT /identity/v3/projects/393a617f4b8d41ada02847c58a923908/users/3a6c7b5b1df343b88798527bedd74112/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:44.942950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e5e35-d716-403f-9587-4daf6a76aefe None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:44.942950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e5e35-d716-403f-9587-4daf6a76aefe None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:44.942950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e5e35-d716-403f-9587-4daf6a76aefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:44.970938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-0c9e5e35-d716-403f-9587-4daf6a76aefe None None] MFA Rules not processed for user `3a6c7b5b1df343b88798527bedd74112`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:44.972142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0c9e5e35-d716-403f-9587-4daf6a76aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:44.994029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5afe1bbe7db4921aace2bc40c94e252'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:44.994728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5afe1bbe7db4921aace2bc40c94e252'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:45.014771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5afe1bbe7db4921aace2bc40c94e252'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:45.015950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5afe1bbe7db4921aace2bc40c94e252'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:45.024301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5afe1bbe7db4921aace2bc40c94e252'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:45.038693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1059/2091] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:45.050437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e5e35-d716-403f-9587-4daf6a76aefe None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:45.051811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0c9e5e35-d716-403f-9587-4daf6a76aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:45.090681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1033/2092] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:44 2022] DELETE /identity/v3/users/d5afe1bbe7db4921aace2bc40c94e252 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:45.118303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e5e35-d716-403f-9587-4daf6a76aefe None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:45.168587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2159774-8163-453b-b3de-01732a2900cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:45.169254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2159774-8163-453b-b3de-01732a2900cf service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:45.169540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2159774-8163-453b-b3de-01732a2900cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:45.169811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2159774-8163-453b-b3de-01732a2900cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:45.226456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2159774-8163-453b-b3de-01732a2900cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:45.227904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2159774-8163-453b-b3de-01732a2900cf service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:45.237051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1060/2093] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:16:45.560955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:45.562492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:45.630462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704418e-0cdd-4ebe-babe-f149d0f3aff8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:45.635069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:45.636639 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:45.636913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:45.637185 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] PATH_INFO: `/v3/projects/831e4324f7274957aabbc36dd37ac2d7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:45.638447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=831e4324f7274957aabbc36dd37ac2d7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:45.640387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:45.744933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831e4324f7274957aabbc36dd37ac2d7', 'request_id': 'req-888a9e98-36d9-4482-add5-8b44f5657389'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:45.751582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831e4324f7274957aabbc36dd37ac2d7', 'request_id': 'req-888a9e98-36d9-4482-add5-8b44f5657389'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:45.756762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831e4324f7274957aabbc36dd37ac2d7', 'request_id': 'req-888a9e98-36d9-4482-add5-8b44f5657389'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:45.871892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] The token cache is being invalidate because project 831e4324f7274957aabbc36dd37ac2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:45.871892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:45.872669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-888a9e98-36d9-4482-add5-8b44f5657389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:45.874564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1034/2094] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:45 2022] DELETE /identity/v3/projects/831e4324f7274957aabbc36dd37ac2d7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:45.879393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764145-4f88-4ade-b249-0d1792952717 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:45.879870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764145-4f88-4ade-b249-0d1792952717 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:45.884860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764145-4f88-4ade-b249-0d1792952717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:45.921699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-40764145-4f88-4ade-b249-0d1792952717 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:45.925016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-40764145-4f88-4ade-b249-0d1792952717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:46.042792 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1061/2095] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:46.050420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee35f00-ed0b-4a66-8432-4239bf789a8a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:46.050715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee35f00-ed0b-4a66-8432-4239bf789a8a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:46.051040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee35f00-ed0b-4a66-8432-4239bf789a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:46.098613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7ee35f00-ed0b-4a66-8432-4239bf789a8a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:46.100101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7ee35f00-ed0b-4a66-8432-4239bf789a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:46.109745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1035/2096] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:46.114315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40764145-4f88-4ade-b249-0d1792952717 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:46.142039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40764145-4f88-4ade-b249-0d1792952717 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:46.149193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dac948-efa3-47fd-8c3b-ec10f59d3af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:46.149843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dac948-efa3-47fd-8c3b-ec10f59d3af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:46.150224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dac948-efa3-47fd-8c3b-ec10f59d3af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:46.150599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dac948-efa3-47fd-8c3b-ec10f59d3af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:46.151796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dac948-efa3-47fd-8c3b-ec10f59d3af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:46.152173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dac948-efa3-47fd-8c3b-ec10f59d3af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:46.153879 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dac948-efa3-47fd-8c3b-ec10f59d3af8 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:46.180696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1062/2097] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:16:46.181766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee35f00-ed0b-4a66-8432-4239bf789a8a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:46.191646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee35f00-ed0b-4a66-8432-4239bf789a8a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:46.197164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b9780-4425-4c3b-bfe3-00cbca45b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:46.197816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b9780-4425-4c3b-bfe3-00cbca45b5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:46.198128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b9780-4425-4c3b-bfe3-00cbca45b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:46.198450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b9780-4425-4c3b-bfe3-00cbca45b5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:46.199142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b9780-4425-4c3b-bfe3-00cbca45b5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:46.201063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b9780-4425-4c3b-bfe3-00cbca45b5e6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:46.326377 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1036/2098] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:46 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:46.331941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dac948-efa3-47fd-8c3b-ec10f59d3af8 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:46.342337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dac948-efa3-47fd-8c3b-ec10f59d3af8 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:46.397151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92797bc-11fd-4590-a8d7-925a874b0ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:46.397990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92797bc-11fd-4590-a8d7-925a874b0ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:46.398308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92797bc-11fd-4590-a8d7-925a874b0ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:46.398584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92797bc-11fd-4590-a8d7-925a874b0ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:46.399335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92797bc-11fd-4590-a8d7-925a874b0ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:46.401244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92797bc-11fd-4590-a8d7-925a874b0ff8 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:46.488729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1063/2099] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:46 2022] POST /identity/v3/users => generated 305 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:46.492935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b9780-4425-4c3b-bfe3-00cbca45b5e6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:46.503373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b9780-4425-4c3b-bfe3-00cbca45b5e6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:46.508009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5f2bf-456c-4e49-8abf-ca3cfa9f04dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:46.508667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5f2bf-456c-4e49-8abf-ca3cfa9f04dc admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:46.508947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5f2bf-456c-4e49-8abf-ca3cfa9f04dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:46.509258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5f2bf-456c-4e49-8abf-ca3cfa9f04dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:46.509969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5f2bf-456c-4e49-8abf-ca3cfa9f04dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:46.511611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5f2bf-456c-4e49-8abf-ca3cfa9f04dc admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:46.522016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1037/2100] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:46.525922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92797bc-11fd-4590-a8d7-925a874b0ff8 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:46.536360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92797bc-11fd-4590-a8d7-925a874b0ff8 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:46.541131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77629f-8400-4e7d-81b9-eb73264c2761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:46.541789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77629f-8400-4e7d-81b9-eb73264c2761 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:46.542120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77629f-8400-4e7d-81b9-eb73264c2761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:46.542910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77629f-8400-4e7d-81b9-eb73264c2761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:46.543663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77629f-8400-4e7d-81b9-eb73264c2761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:46.545322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77629f-8400-4e7d-81b9-eb73264c2761 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:46.555349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1064/2101] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:46.559512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5f2bf-456c-4e49-8abf-ca3cfa9f04dc admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:46.569717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5f2bf-456c-4e49-8abf-ca3cfa9f04dc admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:46.574529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a4a39-eb65-4cde-89ea-ebe601b6716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:46.575418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a4a39-eb65-4cde-89ea-ebe601b6716e admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:46.575698 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a4a39-eb65-4cde-89ea-ebe601b6716e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:46.575970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a4a39-eb65-4cde-89ea-ebe601b6716e admin admin] PATH_INFO: `/v3/projects/b5de984b6f124f3fa78d38893f62e54a/users/e9ff45e272fd4798b984cbc26a3a8fae/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:46.593547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a4a39-eb65-4cde-89ea-ebe601b6716e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5de984b6f124f3fa78d38893f62e54a, user_id=e9ff45e272fd4798b984cbc26a3a8fae, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:46.596556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a4a39-eb65-4cde-89ea-ebe601b6716e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:46.701772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1038/2102] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:46 2022] PUT /identity/v3/projects/b5de984b6f124f3fa78d38893f62e54a/users/e9ff45e272fd4798b984cbc26a3a8fae/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:46.711911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559593b-ff81-4244-a5eb-6377b3225abe None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:46.712200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559593b-ff81-4244-a5eb-6377b3225abe None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:46.712475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559593b-ff81-4244-a5eb-6377b3225abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:46.740400 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-b559593b-ff81-4244-a5eb-6377b3225abe None None] MFA Rules not processed for user `e9ff45e272fd4798b984cbc26a3a8fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:46.741671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b559593b-ff81-4244-a5eb-6377b3225abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:46.803964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1065/2103] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:46.808916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a4a39-eb65-4cde-89ea-ebe601b6716e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:46.869552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a4a39-eb65-4cde-89ea-ebe601b6716e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:46.874186 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36f2ac-f60b-4fc8-8f9d-55e515ae343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:46.874933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36f2ac-f60b-4fc8-8f9d-55e515ae343a admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:46.875211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36f2ac-f60b-4fc8-8f9d-55e515ae343a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:46.875480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36f2ac-f60b-4fc8-8f9d-55e515ae343a admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:46.876196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36f2ac-f60b-4fc8-8f9d-55e515ae343a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:46.878086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36f2ac-f60b-4fc8-8f9d-55e515ae343a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:46.977373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1039/2104] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:46 2022] POST /identity/v3/projects => generated 407 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:46.982243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559593b-ff81-4244-a5eb-6377b3225abe None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:46.993505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559593b-ff81-4244-a5eb-6377b3225abe None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:47.049453 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059ea35-1027-41a4-9163-0c5916bbe85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:47.050154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059ea35-1027-41a4-9163-0c5916bbe85a admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:47.050436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059ea35-1027-41a4-9163-0c5916bbe85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:47.050710 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059ea35-1027-41a4-9163-0c5916bbe85a admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:47.051394 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059ea35-1027-41a4-9163-0c5916bbe85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:47.053299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059ea35-1027-41a4-9163-0c5916bbe85a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:47.130306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1066/2105] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:46 2022] POST /identity/v3/users => generated 310 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:47.134413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36f2ac-f60b-4fc8-8f9d-55e515ae343a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:47.144970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36f2ac-f60b-4fc8-8f9d-55e515ae343a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:47.149696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0bed4-46b1-4b6f-9560-35aed381f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:47.150529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0bed4-46b1-4b6f-9560-35aed381f33d admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:47.150808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0bed4-46b1-4b6f-9560-35aed381f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:47.155481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0bed4-46b1-4b6f-9560-35aed381f33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:47.155481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0bed4-46b1-4b6f-9560-35aed381f33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:47.155481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0bed4-46b1-4b6f-9560-35aed381f33d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:47.164813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1040/2106] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:47.169026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059ea35-1027-41a4-9163-0c5916bbe85a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:47.181653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059ea35-1027-41a4-9163-0c5916bbe85a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:47.187418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c675912-375a-429c-ab3b-6acc8396e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:47.188296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c675912-375a-429c-ab3b-6acc8396e23f admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:47.188575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c675912-375a-429c-ab3b-6acc8396e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:47.188844 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c675912-375a-429c-ab3b-6acc8396e23f admin admin] PATH_INFO: `/v3/projects/95be1e6f0e244d2c8b14a2ad6df15c13/users/2ee391f54edc4488941f73b7ba0a623a/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:47.208528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c675912-375a-429c-ab3b-6acc8396e23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95be1e6f0e244d2c8b14a2ad6df15c13, user_id=2ee391f54edc4488941f73b7ba0a623a, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:47.209357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c675912-375a-429c-ab3b-6acc8396e23f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:47.282897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1067/2107] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:47 2022] PUT /identity/v3/projects/95be1e6f0e244d2c8b14a2ad6df15c13/users/2ee391f54edc4488941f73b7ba0a623a/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:47.287554 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0bed4-46b1-4b6f-9560-35aed381f33d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:47.307757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0bed4-46b1-4b6f-9560-35aed381f33d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:47.376142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c2b21-4db8-4fcd-9aff-0da5f6cd7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:47.376843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c2b21-4db8-4fcd-9aff-0da5f6cd7885 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:47.377128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c2b21-4db8-4fcd-9aff-0da5f6cd7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:47.377451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c2b21-4db8-4fcd-9aff-0da5f6cd7885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:47.378241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c2b21-4db8-4fcd-9aff-0da5f6cd7885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:47.379952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c2b21-4db8-4fcd-9aff-0da5f6cd7885 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:47.390815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1041/2108] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:47.395185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c675912-375a-429c-ab3b-6acc8396e23f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:47.407830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c675912-375a-429c-ab3b-6acc8396e23f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:47.413760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05e3d-be31-444c-81f8-df95ac124a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:47.414723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05e3d-be31-444c-81f8-df95ac124a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:47.415159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05e3d-be31-444c-81f8-df95ac124a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:47.415600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05e3d-be31-444c-81f8-df95ac124a42 admin admin] PATH_INFO: `/v3/projects/95be1e6f0e244d2c8b14a2ad6df15c13/users/2ee391f54edc4488941f73b7ba0a623a/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:47.418662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05e3d-be31-444c-81f8-df95ac124a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95be1e6f0e244d2c8b14a2ad6df15c13, user_id=2ee391f54edc4488941f73b7ba0a623a, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:47.421750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa05e3d-be31-444c-81f8-df95ac124a42 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:47.433606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1068/2109] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:47 2022] PUT /identity/v3/projects/95be1e6f0e244d2c8b14a2ad6df15c13/users/2ee391f54edc4488941f73b7ba0a623a/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:47.445012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84c9ae-cf3d-4609-afa7-181f6442d035 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:47.445477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84c9ae-cf3d-4609-afa7-181f6442d035 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:47.445722 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84c9ae-cf3d-4609-afa7-181f6442d035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:47.475270 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9c84c9ae-cf3d-4609-afa7-181f6442d035 None None] MFA Rules not processed for user `2ee391f54edc4488941f73b7ba0a623a`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:47.476426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9c84c9ae-cf3d-4609-afa7-181f6442d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:47.556087 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1042/2110] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:47 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:47.566914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05e3d-be31-444c-81f8-df95ac124a42 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:47.568585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8fa05e3d-be31-444c-81f8-df95ac124a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:47.622776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa05e3d-be31-444c-81f8-df95ac124a42 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:47.626716 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3b37c-1faa-4a08-990c-7505cf5a6650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:47.627365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3b37c-1faa-4a08-990c-7505cf5a6650 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:47.627677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3b37c-1faa-4a08-990c-7505cf5a6650 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:47.627954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3b37c-1faa-4a08-990c-7505cf5a6650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:47.637978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3b37c-1faa-4a08-990c-7505cf5a6650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:47.639620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3b37c-1faa-4a08-990c-7505cf5a6650 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:47.650799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1069/2111] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:48.079335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84c9ae-cf3d-4609-afa7-181f6442d035 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:48.080411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9c84c9ae-cf3d-4609-afa7-181f6442d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:48.097789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84c9ae-cf3d-4609-afa7-181f6442d035 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:48.097902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16566ce8-019f-42ab-8d65-e15d35db6b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:48.098635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16566ce8-019f-42ab-8d65-e15d35db6b5e service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:48.098910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16566ce8-019f-42ab-8d65-e15d35db6b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:48.099177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16566ce8-019f-42ab-8d65-e15d35db6b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:48.155451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16566ce8-019f-42ab-8d65-e15d35db6b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:48.156930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16566ce8-019f-42ab-8d65-e15d35db6b5e service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:48.166749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1043/2112] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:51.126189 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3b37c-1faa-4a08-990c-7505cf5a6650 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:51.127591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-37b3b37c-1faa-4a08-990c-7505cf5a6650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:51.191582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3b37c-1faa-4a08-990c-7505cf5a6650 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:51.196298 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:51.197180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:51.197451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:51.197721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] PATH_INFO: `/v3/users/3a6c7b5b1df343b88798527bedd74112` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:51.198922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a6c7b5b1df343b88798527bedd74112)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:51.200862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:51.404663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a6c7b5b1df343b88798527bedd74112'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:51.405364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a6c7b5b1df343b88798527bedd74112'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:51.406180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a6c7b5b1df343b88798527bedd74112'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:51.419492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a6c7b5b1df343b88798527bedd74112'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:51.426424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a6c7b5b1df343b88798527bedd74112'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:51.524441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1070/2113] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:51 2022] DELETE /identity/v3/users/3a6c7b5b1df343b88798527bedd74112 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:51.530081 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56833-0473-42a8-9e1a-573be152782f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:51.530992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56833-0473-42a8-9e1a-573be152782f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:51.531148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56833-0473-42a8-9e1a-573be152782f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:51.547923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a6c56833-0473-42a8-9e1a-573be152782f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:51.551342 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a6c56833-0473-42a8-9e1a-573be152782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:51.606414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1044/2114] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:51.616324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:51.617765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:51.674043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccbbb8-54b1-4ee2-8ecb-89cf4734cffa admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:51.677683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc15267-8909-4201-ab7c-500c062b147e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:51.678383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc15267-8909-4201-ab7c-500c062b147e service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:51.678619 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc15267-8909-4201-ab7c-500c062b147e service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:51.678893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc15267-8909-4201-ab7c-500c062b147e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:51.688456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc15267-8909-4201-ab7c-500c062b147e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:51.689873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc15267-8909-4201-ab7c-500c062b147e service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:51.699331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1071/2115] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:52.120246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56833-0473-42a8-9e1a-573be152782f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:52.122003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a6c56833-0473-42a8-9e1a-573be152782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:52.134427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56833-0473-42a8-9e1a-573be152782f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:52.139238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:52.140167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:52.140509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:52.140784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] PATH_INFO: `/v3/projects/393a617f4b8d41ada02847c58a923908` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:52.141953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=393a617f4b8d41ada02847c58a923908)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:52.143899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:52.267482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393a617f4b8d41ada02847c58a923908', 'request_id': 'req-a721c615-e19e-4cb6-9822-67a2cef2d83a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:52.273721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393a617f4b8d41ada02847c58a923908', 'request_id': 'req-a721c615-e19e-4cb6-9822-67a2cef2d83a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:52.279872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393a617f4b8d41ada02847c58a923908', 'request_id': 'req-a721c615-e19e-4cb6-9822-67a2cef2d83a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:52.374487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] The token cache is being invalidate because project 393a617f4b8d41ada02847c58a923908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:52.374766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:52.375379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a721c615-e19e-4cb6-9822-67a2cef2d83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:52.376948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1045/2116] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:52 2022] DELETE /identity/v3/projects/393a617f4b8d41ada02847c58a923908 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:52.381824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0a02-0c93-4d91-a8f2-abc13f4aa6c7 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:52.382292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0a02-0c93-4d91-a8f2-abc13f4aa6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:52.382427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0a02-0c93-4d91-a8f2-abc13f4aa6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:52.411471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2a6a0a02-0c93-4d91-a8f2-abc13f4aa6c7 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:52.412668 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2a6a0a02-0c93-4d91-a8f2-abc13f4aa6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:52.468944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1072/2117] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:52.476480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5010f3-8dee-4823-b385-53fd0a37edf3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:52.476766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5010f3-8dee-4823-b385-53fd0a37edf3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:52.477039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5010f3-8dee-4823-b385-53fd0a37edf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:52.494615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7f5010f3-8dee-4823-b385-53fd0a37edf3 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:52.495781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7f5010f3-8dee-4823-b385-53fd0a37edf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:52.503517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1046/2118] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:52.507405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0a02-0c93-4d91-a8f2-abc13f4aa6c7 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:52.517218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0a02-0c93-4d91-a8f2-abc13f4aa6c7 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:52.521707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42e8c2-7ba6-4e7a-a63d-432dd1638e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:52.522375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42e8c2-7ba6-4e7a-a63d-432dd1638e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:52.522657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42e8c2-7ba6-4e7a-a63d-432dd1638e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:52.522929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42e8c2-7ba6-4e7a-a63d-432dd1638e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:52.523647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42e8c2-7ba6-4e7a-a63d-432dd1638e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:52.523952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42e8c2-7ba6-4e7a-a63d-432dd1638e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:52.525540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42e8c2-7ba6-4e7a-a63d-432dd1638e31 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:52.537041 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1073/2119] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:16:52.541027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5010f3-8dee-4823-b385-53fd0a37edf3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:52.549759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5010f3-8dee-4823-b385-53fd0a37edf3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:52.554611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65d1e7-52a0-4181-b532-061a5163f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:52.555249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65d1e7-52a0-4181-b532-061a5163f947 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:52.555533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65d1e7-52a0-4181-b532-061a5163f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:52.555805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65d1e7-52a0-4181-b532-061a5163f947 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:52.556602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65d1e7-52a0-4181-b532-061a5163f947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:52.559615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65d1e7-52a0-4181-b532-061a5163f947 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:52.645591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1047/2120] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:52 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:52.649827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42e8c2-7ba6-4e7a-a63d-432dd1638e31 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:52.660242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42e8c2-7ba6-4e7a-a63d-432dd1638e31 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:52.714618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719fdee-f05a-4a17-a547-c438da71ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:52.715278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719fdee-f05a-4a17-a547-c438da71ab50 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:52.715559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719fdee-f05a-4a17-a547-c438da71ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:52.715832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719fdee-f05a-4a17-a547-c438da71ab50 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:52.716513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719fdee-f05a-4a17-a547-c438da71ab50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:52.718467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719fdee-f05a-4a17-a547-c438da71ab50 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:52.815302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1074/2121] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:52 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:52.819820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65d1e7-52a0-4181-b532-061a5163f947 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:52.830439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65d1e7-52a0-4181-b532-061a5163f947 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:52.835190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142ac9b-2983-4d3d-ac40-8df7374789d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:52.835898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142ac9b-2983-4d3d-ac40-8df7374789d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:52.836313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142ac9b-2983-4d3d-ac40-8df7374789d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:52.836637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142ac9b-2983-4d3d-ac40-8df7374789d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:52.837468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142ac9b-2983-4d3d-ac40-8df7374789d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:52.839205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142ac9b-2983-4d3d-ac40-8df7374789d7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:52.849606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1048/2122] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:52.853324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719fdee-f05a-4a17-a547-c438da71ab50 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:52.862933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719fdee-f05a-4a17-a547-c438da71ab50 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:52.867468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb4b35-e04c-4509-9094-c4143a3e146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:52.868106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4b35-e04c-4509-9094-c4143a3e146e admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:52.868385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4b35-e04c-4509-9094-c4143a3e146e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:52.868657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4b35-e04c-4509-9094-c4143a3e146e admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:52.869376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb4b35-e04c-4509-9094-c4143a3e146e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:52.871480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb4b35-e04c-4509-9094-c4143a3e146e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:52.880868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1075/2123] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:52.884709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142ac9b-2983-4d3d-ac40-8df7374789d7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:52.894791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142ac9b-2983-4d3d-ac40-8df7374789d7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:52.899344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b6dd-14ed-455d-a74b-69ad77e04ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:52.900242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b6dd-14ed-455d-a74b-69ad77e04ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:52.900470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b6dd-14ed-455d-a74b-69ad77e04ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:52.900743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b6dd-14ed-455d-a74b-69ad77e04ad8 admin admin] PATH_INFO: `/v3/projects/976dfbe73abf49d289e8a39ed92413ab/users/3ef8521080484fe0a63c4ec2b8719983/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:52.914337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1b6dd-14ed-455d-a74b-69ad77e04ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976dfbe73abf49d289e8a39ed92413ab, user_id=3ef8521080484fe0a63c4ec2b8719983, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:52.916957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1b6dd-14ed-455d-a74b-69ad77e04ad8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:52.991804 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1049/2124] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:52 2022] PUT /identity/v3/projects/976dfbe73abf49d289e8a39ed92413ab/users/3ef8521080484fe0a63c4ec2b8719983/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:53.002504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb96fb7-123c-4d76-8530-3cd9e9500067 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:53.002793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb96fb7-123c-4d76-8530-3cd9e9500067 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:53.003152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb96fb7-123c-4d76-8530-3cd9e9500067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:53.028449 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-0bb96fb7-123c-4d76-8530-3cd9e9500067 None None] MFA Rules not processed for user `3ef8521080484fe0a63c4ec2b8719983`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:53.029630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0bb96fb7-123c-4d76-8530-3cd9e9500067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:53.090744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1076/2125] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:53.101675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b6dd-14ed-455d-a74b-69ad77e04ad8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:53.103442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-81d1b6dd-14ed-455d-a74b-69ad77e04ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:53.158037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b6dd-14ed-455d-a74b-69ad77e04ad8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:53.161597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0d8c6-7b01-48d1-9d94-d74d25c8c7d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:53.162269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0d8c6-7b01-48d1-9d94-d74d25c8c7d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:53.162549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0d8c6-7b01-48d1-9d94-d74d25c8c7d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:53.162825 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0d8c6-7b01-48d1-9d94-d74d25c8c7d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:53.172682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0d8c6-7b01-48d1-9d94-d74d25c8c7d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:53.174229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0d8c6-7b01-48d1-9d94-d74d25c8c7d1 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:53.182979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1050/2126] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:53.207888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb96fb7-123c-4d76-8530-3cd9e9500067 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:53.267802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb96fb7-123c-4d76-8530-3cd9e9500067 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:53.272609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:53.273511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:53.273793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:53.274086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] PATH_INFO: `/v3/users/3ef8521080484fe0a63c4ec2b8719983` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:53.275430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef8521080484fe0a63c4ec2b8719983)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:53.277396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:53.495425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef8521080484fe0a63c4ec2b8719983'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:53.496123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef8521080484fe0a63c4ec2b8719983'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:53.496686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef8521080484fe0a63c4ec2b8719983'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:53.507997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef8521080484fe0a63c4ec2b8719983'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:53.514556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef8521080484fe0a63c4ec2b8719983'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:53.580666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1077/2127] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:53 2022] DELETE /identity/v3/users/3ef8521080484fe0a63c4ec2b8719983 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:53.585085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7fbaf-a578-450e-81ce-ab7d864acceb None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:53.585564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7fbaf-a578-450e-81ce-ab7d864acceb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:53.585690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7fbaf-a578-450e-81ce-ab7d864acceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:53.602688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bfb7fbaf-a578-450e-81ce-ab7d864acceb None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:53.603857 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bfb7fbaf-a578-450e-81ce-ab7d864acceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:53.661319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1051/2128] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:53.671561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:53.672985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:53.728737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748080f-40a0-4334-951f-33207f831115 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:53.733310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89fb27-005b-42d0-829e-5266e3a692f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:53.733952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89fb27-005b-42d0-829e-5266e3a692f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:53.734262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89fb27-005b-42d0-829e-5266e3a692f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:53.734535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89fb27-005b-42d0-829e-5266e3a692f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:53.743477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89fb27-005b-42d0-829e-5266e3a692f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:53.744888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89fb27-005b-42d0-829e-5266e3a692f1 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:53.754034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1078/2129] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:54.194220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7fbaf-a578-450e-81ce-ab7d864acceb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:54.195666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bfb7fbaf-a578-450e-81ce-ab7d864acceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:54.208219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7fbaf-a578-450e-81ce-ab7d864acceb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:54.212937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:54.221080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.221080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.221080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] PATH_INFO: `/v3/projects/976dfbe73abf49d289e8a39ed92413ab` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.221080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976dfbe73abf49d289e8a39ed92413ab)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:54.221080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:54.317601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976dfbe73abf49d289e8a39ed92413ab', 'request_id': 'req-8b0c7f8d-fb02-458f-811e-6bf5392f9471'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:54.324421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976dfbe73abf49d289e8a39ed92413ab', 'request_id': 'req-8b0c7f8d-fb02-458f-811e-6bf5392f9471'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:54.329537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976dfbe73abf49d289e8a39ed92413ab', 'request_id': 'req-8b0c7f8d-fb02-458f-811e-6bf5392f9471'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:54.385526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] The token cache is being invalidate because project 976dfbe73abf49d289e8a39ed92413ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:54.385808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:54.387026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8b0c7f8d-fb02-458f-811e-6bf5392f9471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:54.388591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1052/2130] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:54 2022] DELETE /identity/v3/projects/976dfbe73abf49d289e8a39ed92413ab => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:54.393647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576e0a8-8771-45ac-9085-db6293368426 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.393939 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576e0a8-8771-45ac-9085-db6293368426 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.394240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576e0a8-8771-45ac-9085-db6293368426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.411185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f576e0a8-8771-45ac-9085-db6293368426 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:54.412383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f576e0a8-8771-45ac-9085-db6293368426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:54.472818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1079/2131] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:54.481061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212bf5f-e9ca-4a97-8622-e48cf3adb139 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.481357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212bf5f-e9ca-4a97-8622-e48cf3adb139 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.481634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212bf5f-e9ca-4a97-8622-e48cf3adb139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.500472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0212bf5f-e9ca-4a97-8622-e48cf3adb139 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:54.501707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0212bf5f-e9ca-4a97-8622-e48cf3adb139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:54.509821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1053/2132] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:54.514386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576e0a8-8771-45ac-9085-db6293368426 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:54.523813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576e0a8-8771-45ac-9085-db6293368426 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:54.528447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3100ea-90ff-4a81-b14f-e52627f97562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:54.529096 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3100ea-90ff-4a81-b14f-e52627f97562 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.529376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3100ea-90ff-4a81-b14f-e52627f97562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.529732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3100ea-90ff-4a81-b14f-e52627f97562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.530461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3100ea-90ff-4a81-b14f-e52627f97562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:54.530769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3100ea-90ff-4a81-b14f-e52627f97562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:54.532415 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3100ea-90ff-4a81-b14f-e52627f97562 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:54.547309 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1080/2133] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:16:54.548697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212bf5f-e9ca-4a97-8622-e48cf3adb139 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:54.557950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212bf5f-e9ca-4a97-8622-e48cf3adb139 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:54.563329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5921e-5441-4b11-92f6-31b21cbfff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:54.563976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5921e-5441-4b11-92f6-31b21cbfff9f admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.564256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5921e-5441-4b11-92f6-31b21cbfff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.564529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5921e-5441-4b11-92f6-31b21cbfff9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.565220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5921e-5441-4b11-92f6-31b21cbfff9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:54.567190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5921e-5441-4b11-92f6-31b21cbfff9f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:54.628855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1054/2134] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:54 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:54.632949 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3100ea-90ff-4a81-b14f-e52627f97562 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:54.642777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3100ea-90ff-4a81-b14f-e52627f97562 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:54.697408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da635d4c-6681-43d4-926d-50daa0ab2947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:54.698013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da635d4c-6681-43d4-926d-50daa0ab2947 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.698322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da635d4c-6681-43d4-926d-50daa0ab2947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.698592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da635d4c-6681-43d4-926d-50daa0ab2947 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.699320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da635d4c-6681-43d4-926d-50daa0ab2947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:54.701208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da635d4c-6681-43d4-926d-50daa0ab2947 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:54.766828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1081/2135] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:54 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:54.770453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5921e-5441-4b11-92f6-31b21cbfff9f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:54.788325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5921e-5441-4b11-92f6-31b21cbfff9f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:54.796249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c39eb2-c743-4f9e-b197-30c45debec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:54.797209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c39eb2-c743-4f9e-b197-30c45debec03 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.797209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c39eb2-c743-4f9e-b197-30c45debec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.797676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c39eb2-c743-4f9e-b197-30c45debec03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.798448 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c39eb2-c743-4f9e-b197-30c45debec03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:54.800112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c39eb2-c743-4f9e-b197-30c45debec03 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:54.821588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1055/2136] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:54.825608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da635d4c-6681-43d4-926d-50daa0ab2947 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:54.836136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da635d4c-6681-43d4-926d-50daa0ab2947 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:54.840994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce7cc0-ab89-4acf-90ad-21f2db0f8835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:54.842027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce7cc0-ab89-4acf-90ad-21f2db0f8835 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.842027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce7cc0-ab89-4acf-90ad-21f2db0f8835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.842234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce7cc0-ab89-4acf-90ad-21f2db0f8835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.843106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce7cc0-ab89-4acf-90ad-21f2db0f8835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:54.844839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce7cc0-ab89-4acf-90ad-21f2db0f8835 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:54.856224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1082/2137] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:54.860312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c39eb2-c743-4f9e-b197-30c45debec03 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:54.870296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c39eb2-c743-4f9e-b197-30c45debec03 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:54.875524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b1b28-e8f3-4f5e-b22d-ea3c675d6816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:54.876399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b1b28-e8f3-4f5e-b22d-ea3c675d6816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.876675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b1b28-e8f3-4f5e-b22d-ea3c675d6816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.876951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b1b28-e8f3-4f5e-b22d-ea3c675d6816 admin admin] PATH_INFO: `/v3/projects/18afd7d9815342c196be824d2b99d537/users/064ef0ac470b458ba5a675364f9cab31/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.893086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b1b28-e8f3-4f5e-b22d-ea3c675d6816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18afd7d9815342c196be824d2b99d537, user_id=064ef0ac470b458ba5a675364f9cab31, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:54.896346 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b1b28-e8f3-4f5e-b22d-ea3c675d6816 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:54.970279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1056/2138] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:54 2022] PUT /identity/v3/projects/18afd7d9815342c196be824d2b99d537/users/064ef0ac470b458ba5a675364f9cab31/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:54.975202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072b52-2624-4ae3-b7a2-ea42aa42dd5c None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:54.975495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072b52-2624-4ae3-b7a2-ea42aa42dd5c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:54.975783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072b52-2624-4ae3-b7a2-ea42aa42dd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:54.994096 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-1a072b52-2624-4ae3-b7a2-ea42aa42dd5c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:54.995297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1a072b52-2624-4ae3-b7a2-ea42aa42dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:55.052803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1083/2139] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:16:55.073725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b1b28-e8f3-4f5e-b22d-ea3c675d6816 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:55.075488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-731b1b28-e8f3-4f5e-b22d-ea3c675d6816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:55.142775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b1b28-e8f3-4f5e-b22d-ea3c675d6816 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:55.146488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9a666-4584-4df3-b506-2480f99ab921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:55.147134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9a666-4584-4df3-b506-2480f99ab921 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:55.147413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9a666-4584-4df3-b506-2480f99ab921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:55.147685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9a666-4584-4df3-b506-2480f99ab921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:55.157230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9a666-4584-4df3-b506-2480f99ab921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:55.158710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9a666-4584-4df3-b506-2480f99ab921 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:55.168996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1057/2140] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:57.051069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a072b52-2624-4ae3-b7a2-ea42aa42dd5c None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:57.054015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1a072b52-2624-4ae3-b7a2-ea42aa42dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:57.067228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a072b52-2624-4ae3-b7a2-ea42aa42dd5c None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:57.072451 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:57.073564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:57.074029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:57.074366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] PATH_INFO: `/v3/users/6b541636e0c74f0ab50614a358949921` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:57.075590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b541636e0c74f0ab50614a358949921)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:57.077771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:57.314760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b541636e0c74f0ab50614a358949921'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:57.315419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b541636e0c74f0ab50614a358949921'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:57.316221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b541636e0c74f0ab50614a358949921'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:57.329022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b541636e0c74f0ab50614a358949921'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:57.336035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b541636e0c74f0ab50614a358949921'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:57.431967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1084/2141] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:57 2022] DELETE /identity/v3/users/6b541636e0c74f0ab50614a358949921 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:57.436488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e3c2f-e4c0-4b2b-adb7-f1a16c21eb83 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:57.436950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e3c2f-e4c0-4b2b-adb7-f1a16c21eb83 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:57.437070 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e3c2f-e4c0-4b2b-adb7-f1a16c21eb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:57.456651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-212e3c2f-e4c0-4b2b-adb7-f1a16c21eb83 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:57.457845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-212e3c2f-e4c0-4b2b-adb7-f1a16c21eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:57.526886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1058/2142] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:57.537464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:57.538937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:57.622648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de4000-a3a3-4da8-9905-2f54358cfadf admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:57.627007 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b349d96-5ff7-44e5-92f6-fd69dfd9df26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:57.627790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349d96-5ff7-44e5-92f6-fd69dfd9df26 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:57.628200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349d96-5ff7-44e5-92f6-fd69dfd9df26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:57.628828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349d96-5ff7-44e5-92f6-fd69dfd9df26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:57.641874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b349d96-5ff7-44e5-92f6-fd69dfd9df26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:57.641874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b349d96-5ff7-44e5-92f6-fd69dfd9df26 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:57.653973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1085/2143] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:16:58.468086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e3c2f-e4c0-4b2b-adb7-f1a16c21eb83 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:58.470765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-212e3c2f-e4c0-4b2b-adb7-f1a16c21eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:58.485553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e3c2f-e4c0-4b2b-adb7-f1a16c21eb83 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:58.490964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:58.492336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:58.492823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:58.493296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] PATH_INFO: `/v3/projects/73c8a191b8134f3388fb7ec5a206bbd7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:58.503911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c8a191b8134f3388fb7ec5a206bbd7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:58.507668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:58.673554 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c8a191b8134f3388fb7ec5a206bbd7', 'request_id': 'req-3fb919b6-e034-402e-aaf7-0dca1f3137c9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:58.680275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c8a191b8134f3388fb7ec5a206bbd7', 'request_id': 'req-3fb919b6-e034-402e-aaf7-0dca1f3137c9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:58.687051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c8a191b8134f3388fb7ec5a206bbd7', 'request_id': 'req-3fb919b6-e034-402e-aaf7-0dca1f3137c9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:58.812860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] The token cache is being invalidate because project 73c8a191b8134f3388fb7ec5a206bbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:16:58.813355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:58.814204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3fb919b6-e034-402e-aaf7-0dca1f3137c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:58.817055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1059/2144] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:16:58 2022] DELETE /identity/v3/projects/73c8a191b8134f3388fb7ec5a206bbd7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:58.822665 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9e060-09c2-4099-a8f2-e0f7cf625d27 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:58.824015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9e060-09c2-4099-a8f2-e0f7cf625d27 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:58.824295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9e060-09c2-4099-a8f2-e0f7cf625d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:58.855651 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3ed9e060-09c2-4099-a8f2-e0f7cf625d27 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:58.856872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3ed9e060-09c2-4099-a8f2-e0f7cf625d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:58.952211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1086/2145] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:58.964420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdd6a7-5d69-4696-a2e3-099c585efb68 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:58.964420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdd6a7-5d69-4696-a2e3-099c585efb68 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:58.964420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdd6a7-5d69-4696-a2e3-099c585efb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:58.980058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bdbdd6a7-5d69-4696-a2e3-099c585efb68 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:58.981266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bdbdd6a7-5d69-4696-a2e3-099c585efb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:58.997405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1060/2146] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:58.998765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9e060-09c2-4099-a8f2-e0f7cf625d27 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:59.010439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9e060-09c2-4099-a8f2-e0f7cf625d27 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:59.031136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af2e61-8e56-44ef-89e8-91498aca2e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:59.031813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af2e61-8e56-44ef-89e8-91498aca2e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:59.032094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af2e61-8e56-44ef-89e8-91498aca2e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:59.032366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af2e61-8e56-44ef-89e8-91498aca2e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:59.033236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af2e61-8e56-44ef-89e8-91498aca2e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:16:59.033657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af2e61-8e56-44ef-89e8-91498aca2e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:59.035578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af2e61-8e56-44ef-89e8-91498aca2e6d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:59.055559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1087/2147] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:16:59.060574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdd6a7-5d69-4696-a2e3-099c585efb68 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:59.079866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdd6a7-5d69-4696-a2e3-099c585efb68 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:59.091662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a8b09-39e3-4149-b089-d0f2a01982d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:59.092493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a8b09-39e3-4149-b089-d0f2a01982d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:59.092774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a8b09-39e3-4149-b089-d0f2a01982d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:59.093174 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a8b09-39e3-4149-b089-d0f2a01982d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:59.094465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a8b09-39e3-4149-b089-d0f2a01982d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:59.096557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a8b09-39e3-4149-b089-d0f2a01982d4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:59.200262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1061/2148] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:59 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:16:59.204491 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af2e61-8e56-44ef-89e8-91498aca2e6d admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:59.216758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af2e61-8e56-44ef-89e8-91498aca2e6d admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:59.280150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd1fff-bff4-4013-ae65-c3d761cdfbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:59.280824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd1fff-bff4-4013-ae65-c3d761cdfbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:59.281111 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd1fff-bff4-4013-ae65-c3d761cdfbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:59.281377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd1fff-bff4-4013-ae65-c3d761cdfbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:59.282096 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd1fff-bff4-4013-ae65-c3d761cdfbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:59.284100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd1fff-bff4-4013-ae65-c3d761cdfbd5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:59.391636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1088/2149] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:16:59 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:16:59.391859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a8b09-39e3-4149-b089-d0f2a01982d4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:59.409178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a8b09-39e3-4149-b089-d0f2a01982d4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:59.446737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61961ff6-a0f3-4c70-96bb-ef956cc60c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:59.448216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961ff6-a0f3-4c70-96bb-ef956cc60c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:59.448599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961ff6-a0f3-4c70-96bb-ef956cc60c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:59.448880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961ff6-a0f3-4c70-96bb-ef956cc60c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:59.449633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61961ff6-a0f3-4c70-96bb-ef956cc60c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:59.451374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61961ff6-a0f3-4c70-96bb-ef956cc60c90 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:59.465142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd1fff-bff4-4013-ae65-c3d761cdfbd5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:59.465967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-03fd1fff-bff4-4013-ae65-c3d761cdfbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:59.486187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd1fff-bff4-4013-ae65-c3d761cdfbd5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:59.492155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:59.493770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:59.494234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:59.494640 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] PATH_INFO: `/v3/users/e9ff45e272fd4798b984cbc26a3a8fae` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:59.498410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ff45e272fd4798b984cbc26a3a8fae)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:59.498799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:59.503383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1062/2150] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:16:59.508380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61961ff6-a0f3-4c70-96bb-ef956cc60c90 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:59.544710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61961ff6-a0f3-4c70-96bb-ef956cc60c90 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:59.565614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a0bd-f9fe-4d09-8979-d0d2f04eea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:59.566333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a0bd-f9fe-4d09-8979-d0d2f04eea9c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:59.566615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a0bd-f9fe-4d09-8979-d0d2f04eea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:59.566905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a0bd-f9fe-4d09-8979-d0d2f04eea9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:59.567654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a0bd-f9fe-4d09-8979-d0d2f04eea9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:59.569618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a0bd-f9fe-4d09-8979-d0d2f04eea9c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:59.596861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1063/2151] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:16:59.601282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a0bd-f9fe-4d09-8979-d0d2f04eea9c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:59.619613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a0bd-f9fe-4d09-8979-d0d2f04eea9c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:16:59.624602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c62644-2892-4be9-be89-fb354da131c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:16:59.626015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c62644-2892-4be9-be89-fb354da131c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:59.626491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c62644-2892-4be9-be89-fb354da131c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:59.627030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c62644-2892-4be9-be89-fb354da131c0 admin admin] PATH_INFO: `/v3/projects/528a5c91268c4f669f9cd678fc4accf2/users/2289318f8dbb4bceb0f501ef45d70825/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:59.660016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c62644-2892-4be9-be89-fb354da131c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528a5c91268c4f669f9cd678fc4accf2, user_id=2289318f8dbb4bceb0f501ef45d70825, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:16:59.663166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c62644-2892-4be9-be89-fb354da131c0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:16:59.753410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ff45e272fd4798b984cbc26a3a8fae'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:59.754279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ff45e272fd4798b984cbc26a3a8fae'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:59.761735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ff45e272fd4798b984cbc26a3a8fae'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:59.776061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ff45e272fd4798b984cbc26a3a8fae'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:59.786998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1064/2152] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:16:59 2022] PUT /identity/v3/projects/528a5c91268c4f669f9cd678fc4accf2/users/2289318f8dbb4bceb0f501ef45d70825/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:16:59.788058 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1c2340e0-ad73-4361-b925-272340336c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ff45e272fd4798b984cbc26a3a8fae'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:16:59.798663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fefbc-7559-486a-a0a7-1245f301333f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:59.799049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fefbc-7559-486a-a0a7-1245f301333f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:59.799441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fefbc-7559-486a-a0a7-1245f301333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:59.832633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-784fefbc-7559-486a-a0a7-1245f301333f None None] MFA Rules not processed for user `2289318f8dbb4bceb0f501ef45d70825`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:59.836349 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-784fefbc-7559-486a-a0a7-1245f301333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:59.892173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1089/2153] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:16:59 2022] DELETE /identity/v3/users/e9ff45e272fd4798b984cbc26a3a8fae => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:16:59.897022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ed96-855f-4f1d-8641-50ab680f9ae5 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:16:59.897312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ed96-855f-4f1d-8641-50ab680f9ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:16:59.897588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7ed96-855f-4f1d-8641-50ab680f9ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:16:59.935328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f3d7ed96-855f-4f1d-8641-50ab680f9ae5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:16:59.936894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f3d7ed96-855f-4f1d-8641-50ab680f9ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:16:59.948385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1065/2154] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:16:59.952773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fefbc-7559-486a-a0a7-1245f301333f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:16:59.954222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-784fefbc-7559-486a-a0a7-1245f301333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:00.011708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1090/2155] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:17:00.022156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7ed96-855f-4f1d-8641-50ab680f9ae5 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:00.023529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f3d7ed96-855f-4f1d-8641-50ab680f9ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:00.033720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fefbc-7559-486a-a0a7-1245f301333f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:00.038528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438734f-5a34-41d1-9620-67ad2b50ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:00.039399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438734f-5a34-41d1-9620-67ad2b50ca63 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:00.039703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438734f-5a34-41d1-9620-67ad2b50ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:00.039987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438734f-5a34-41d1-9620-67ad2b50ca63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:00.040680 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438734f-5a34-41d1-9620-67ad2b50ca63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:00.043245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438734f-5a34-41d1-9620-67ad2b50ca63 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:00.091829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7ed96-855f-4f1d-8641-50ab680f9ae5 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:00.095835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c727ab-7d66-4101-908c-9d616291c074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:00.096495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c727ab-7d66-4101-908c-9d616291c074 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:00.096777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c727ab-7d66-4101-908c-9d616291c074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:00.097048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c727ab-7d66-4101-908c-9d616291c074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:00.107498 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c727ab-7d66-4101-908c-9d616291c074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:00.108965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c727ab-7d66-4101-908c-9d616291c074 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:00.118904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1091/2156] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:17:00.163512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1066/2157] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:16:59 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:00.168211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c727ab-7d66-4101-908c-9d616291c074 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:00.185835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c727ab-7d66-4101-908c-9d616291c074 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:00.286862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ca43e-c8c8-4d62-853b-8df274e32ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:00.288838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ca43e-c8c8-4d62-853b-8df274e32ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:00.289511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ca43e-c8c8-4d62-853b-8df274e32ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:00.290764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ca43e-c8c8-4d62-853b-8df274e32ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:00.292865 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ca43e-c8c8-4d62-853b-8df274e32ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:00.296405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ca43e-c8c8-4d62-853b-8df274e32ce4 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:00.416514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1092/2158] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:00 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:00.421075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438734f-5a34-41d1-9620-67ad2b50ca63 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:00.439654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438734f-5a34-41d1-9620-67ad2b50ca63 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:00.444681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335af091-e147-4edb-80b8-b0165b659905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:00.445364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af091-e147-4edb-80b8-b0165b659905 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:00.445646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af091-e147-4edb-80b8-b0165b659905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:00.445921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335af091-e147-4edb-80b8-b0165b659905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:00.446698 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335af091-e147-4edb-80b8-b0165b659905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:00.448352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335af091-e147-4edb-80b8-b0165b659905 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:00.463951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ca43e-c8c8-4d62-853b-8df274e32ce4 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:00.464135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1067/2159] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:00.488088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ca43e-c8c8-4d62-853b-8df274e32ce4 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:00.499182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c848b-f7cd-465f-8d11-795b179ab92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:00.500083 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c848b-f7cd-465f-8d11-795b179ab92f admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:00.500365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c848b-f7cd-465f-8d11-795b179ab92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:00.500638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c848b-f7cd-465f-8d11-795b179ab92f admin admin] PATH_INFO: `/v3/projects/ad5037759c7c4e91bc358d977a337c01/users/2b1d0d3e694a4100be9d4204e72de4c2/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:00.533275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c848b-f7cd-465f-8d11-795b179ab92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5037759c7c4e91bc358d977a337c01, user_id=2b1d0d3e694a4100be9d4204e72de4c2, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:00.536422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c848b-f7cd-465f-8d11-795b179ab92f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:00.642750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1093/2160] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:00 2022] PUT /identity/v3/projects/ad5037759c7c4e91bc358d977a337c01/users/2b1d0d3e694a4100be9d4204e72de4c2/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:00.646704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335af091-e147-4edb-80b8-b0165b659905 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:00.658210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335af091-e147-4edb-80b8-b0165b659905 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:00.720418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25891-ba90-4a61-abb9-b57c38956afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:00.721068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25891-ba90-4a61-abb9-b57c38956afb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:00.721451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25891-ba90-4a61-abb9-b57c38956afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:00.721741 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25891-ba90-4a61-abb9-b57c38956afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:00.722508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25891-ba90-4a61-abb9-b57c38956afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:00.724126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25891-ba90-4a61-abb9-b57c38956afb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:00.733334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c848b-f7cd-465f-8d11-795b179ab92f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:00.735328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-862c848b-f7cd-465f-8d11-795b179ab92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:00.742635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1068/2161] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:00.753319 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c848b-f7cd-465f-8d11-795b179ab92f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:00.769064 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25891-ba90-4a61-abb9-b57c38956afb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:00.789841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:00.791211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:00.791619 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:00.792027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] PATH_INFO: `/v3/projects/b5de984b6f124f3fa78d38893f62e54a` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:00.808921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5de984b6f124f3fa78d38893f62e54a)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:00.808921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:00.812780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25891-ba90-4a61-abb9-b57c38956afb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:00.821950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e14e-6b53-4aea-aea4-94832bf79b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:00.842235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e14e-6b53-4aea-aea4-94832bf79b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:00.842596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e14e-6b53-4aea-aea4-94832bf79b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:00.842885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e14e-6b53-4aea-aea4-94832bf79b46 admin admin] PATH_INFO: `/v3/projects/ad5037759c7c4e91bc358d977a337c01/users/2b1d0d3e694a4100be9d4204e72de4c2/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:00.845296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e14e-6b53-4aea-aea4-94832bf79b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5037759c7c4e91bc358d977a337c01, user_id=2b1d0d3e694a4100be9d4204e72de4c2, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:00.848556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e14e-6b53-4aea-aea4-94832bf79b46 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:00.882100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1069/2162] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:00 2022] PUT /identity/v3/projects/ad5037759c7c4e91bc358d977a337c01/users/2b1d0d3e694a4100be9d4204e72de4c2/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:00.882100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d0577-3d83-45d1-8861-7c44a9d3edfb None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:00.882100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d0577-3d83-45d1-8861-7c44a9d3edfb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:00.882100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d0577-3d83-45d1-8861-7c44a9d3edfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:00.907398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-790d0577-3d83-45d1-8861-7c44a9d3edfb None None] MFA Rules not processed for user `665ea1968aff4e949cdf07c210e78067`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:00.908843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-790d0577-3d83-45d1-8861-7c44a9d3edfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:00.966589 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5de984b6f124f3fa78d38893f62e54a', 'request_id': 'req-6f7bc7e5-908b-4961-a215-38679e2d356b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.022271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1070/2163] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:01.035837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c63d5-11ce-4f2c-b48d-21c23628f4c5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:01.035837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c63d5-11ce-4f2c-b48d-21c23628f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:01.035837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c63d5-11ce-4f2c-b48d-21c23628f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:01.050384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5de984b6f124f3fa78d38893f62e54a', 'request_id': 'req-6f7bc7e5-908b-4961-a215-38679e2d356b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.059230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e56c63d5-11ce-4f2c-b48d-21c23628f4c5 None None] MFA Rules not processed for user `2b1d0d3e694a4100be9d4204e72de4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:01.059881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e56c63d5-11ce-4f2c-b48d-21c23628f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:01.062781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5de984b6f124f3fa78d38893f62e54a', 'request_id': 'req-6f7bc7e5-908b-4961-a215-38679e2d356b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.088496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] The token cache is being invalidate because project b5de984b6f124f3fa78d38893f62e54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:01.088837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.090408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.095482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1094/2164] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:00 2022] DELETE /identity/v3/projects/b5de984b6f124f3fa78d38893f62e54a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:01.099333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:01.100942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:01.197861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc7e5-908b-4961-a215-38679e2d356b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:01.199315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1071/2165] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:01.206509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c63d5-11ce-4f2c-b48d-21c23628f4c5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:01.208242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e56c63d5-11ce-4f2c-b48d-21c23628f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:01.211647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:01.212695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:01.212981 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:01.213258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] PATH_INFO: `/v3/users/2ee391f54edc4488941f73b7ba0a623a` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:01.215102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee391f54edc4488941f73b7ba0a623a)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:01.217274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:01.320342 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c63d5-11ce-4f2c-b48d-21c23628f4c5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:01.324992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b180dc4-6e0e-4d7b-9214-9a7ba433edcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:01.325655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b180dc4-6e0e-4d7b-9214-9a7ba433edcb service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:01.325932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b180dc4-6e0e-4d7b-9214-9a7ba433edcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:01.326235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b180dc4-6e0e-4d7b-9214-9a7ba433edcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:01.338521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b180dc4-6e0e-4d7b-9214-9a7ba433edcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:01.341082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b180dc4-6e0e-4d7b-9214-9a7ba433edcb service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:01.351985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1072/2166] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:01.438256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee391f54edc4488941f73b7ba0a623a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.440488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee391f54edc4488941f73b7ba0a623a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.442032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee391f54edc4488941f73b7ba0a623a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.480292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee391f54edc4488941f73b7ba0a623a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.492813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b610f870-f470-4baa-8b6f-a70b764b32c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee391f54edc4488941f73b7ba0a623a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:01.499628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b180dc4-6e0e-4d7b-9214-9a7ba433edcb service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:01.510076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b180dc4-6e0e-4d7b-9214-9a7ba433edcb service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:01.518513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:01.519421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:01.519741 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:01.520088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:01.522032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:01.599705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1095/2167] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:01 2022] DELETE /identity/v3/users/2ee391f54edc4488941f73b7ba0a623a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:01.646517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:01.648110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:01.659641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1073/2168] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:17:01.769208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a922f-95f7-4937-8040-6152456b60a4 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:01.769490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a922f-95f7-4937-8040-6152456b60a4 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:01.769765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a922f-95f7-4937-8040-6152456b60a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:01.803622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e29a922f-95f7-4937-8040-6152456b60a4 None None] MFA Rules not processed for user `064ef0ac470b458ba5a675364f9cab31`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:01.807544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e29a922f-95f7-4937-8040-6152456b60a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:01.874172 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1096/2169] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:01.878694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:01.880078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:01.897624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be388-9dac-4fd3-87c8-77fe93e23755 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:01.979402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651605cd-e47e-49cc-92ca-1016c677132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:01.979402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651605cd-e47e-49cc-92ca-1016c677132b admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:01.979402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651605cd-e47e-49cc-92ca-1016c677132b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:01.979402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651605cd-e47e-49cc-92ca-1016c677132b admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:01.979933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651605cd-e47e-49cc-92ca-1016c677132b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:01.979933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651605cd-e47e-49cc-92ca-1016c677132b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:02.124887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1074/2170] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:01 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:02.128790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a922f-95f7-4937-8040-6152456b60a4 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:02.143237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a922f-95f7-4937-8040-6152456b60a4 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:02.234755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651605cd-e47e-49cc-92ca-1016c677132b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:02.235496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-651605cd-e47e-49cc-92ca-1016c677132b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:02.237496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240367a2-2ac5-4266-8f2b-11a861446cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:02.238520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240367a2-2ac5-4266-8f2b-11a861446cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.238998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240367a2-2ac5-4266-8f2b-11a861446cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.239477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240367a2-2ac5-4266-8f2b-11a861446cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.241078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240367a2-2ac5-4266-8f2b-11a861446cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:02.245712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240367a2-2ac5-4266-8f2b-11a861446cc8 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:02.265928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651605cd-e47e-49cc-92ca-1016c677132b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:02.296529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:02.302069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.302218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.305304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] PATH_INFO: `/v3/projects/95be1e6f0e244d2c8b14a2ad6df15c13` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.326479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95be1e6f0e244d2c8b14a2ad6df15c13)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:02.326479 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:02.346763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1097/2171] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:02 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:02.350809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240367a2-2ac5-4266-8f2b-11a861446cc8 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:02.363454 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240367a2-2ac5-4266-8f2b-11a861446cc8 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:02.368374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c2a35-a9a9-4f4e-a5f8-728b5aa1301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:02.369147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c2a35-a9a9-4f4e-a5f8-728b5aa1301b admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.369426 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c2a35-a9a9-4f4e-a5f8-728b5aa1301b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.369696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c2a35-a9a9-4f4e-a5f8-728b5aa1301b admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.371134 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c2a35-a9a9-4f4e-a5f8-728b5aa1301b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:02.372724 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c2a35-a9a9-4f4e-a5f8-728b5aa1301b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:02.382618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1098/2172] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:17:02.387361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c2a35-a9a9-4f4e-a5f8-728b5aa1301b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:02.401935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c2a35-a9a9-4f4e-a5f8-728b5aa1301b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:02.408319 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f063c4-1017-4d0f-8d15-36aeac278568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:02.409199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f063c4-1017-4d0f-8d15-36aeac278568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.409502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f063c4-1017-4d0f-8d15-36aeac278568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.409789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f063c4-1017-4d0f-8d15-36aeac278568 admin admin] PATH_INFO: `/v3/projects/11ad64bf66f149b5900180b8c8d7420f/users/3e186a9c07fa486a9aa747e2e3185cb8/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.428455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f063c4-1017-4d0f-8d15-36aeac278568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ad64bf66f149b5900180b8c8d7420f, user_id=3e186a9c07fa486a9aa747e2e3185cb8, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:02.431679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f063c4-1017-4d0f-8d15-36aeac278568 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:02.495868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1099/2173] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:02 2022] PUT /identity/v3/projects/11ad64bf66f149b5900180b8c8d7420f/users/3e186a9c07fa486a9aa747e2e3185cb8/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:17:02.499721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f063c4-1017-4d0f-8d15-36aeac278568 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:02.507340 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95be1e6f0e244d2c8b14a2ad6df15c13', 'request_id': 'req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:02.514556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95be1e6f0e244d2c8b14a2ad6df15c13', 'request_id': 'req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:02.520387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95be1e6f0e244d2c8b14a2ad6df15c13', 'request_id': 'req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:02.563602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f063c4-1017-4d0f-8d15-36aeac278568 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:02.629311 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca293cf-5b20-4677-b473-24a30e5adc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:02.629775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca293cf-5b20-4677-b473-24a30e5adc9f admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.630034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca293cf-5b20-4677-b473-24a30e5adc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.630801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca293cf-5b20-4677-b473-24a30e5adc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.631580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca293cf-5b20-4677-b473-24a30e5adc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:02.633340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca293cf-5b20-4677-b473-24a30e5adc9f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:02.642607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] The token cache is being invalidate because project 95be1e6f0e244d2c8b14a2ad6df15c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:02.643199 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:02.645378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1100/2174] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:17:02.649038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5881c5f2-2f3d-4a80-8635-fa524f9f08d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:02.649508 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca293cf-5b20-4677-b473-24a30e5adc9f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:02.651387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1075/2175] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:02 2022] DELETE /identity/v3/projects/95be1e6f0e244d2c8b14a2ad6df15c13 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:17:02.651510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bca293cf-5b20-4677-b473-24a30e5adc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:02.660414 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806aee-225f-4f38-bf61-22832150d753 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.663128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806aee-225f-4f38-bf61-22832150d753 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.663591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec806aee-225f-4f38-bf61-22832150d753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.668842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca293cf-5b20-4677-b473-24a30e5adc9f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:02.674549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1662172-5f78-46c0-8e35-741a1444d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:02.676410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662172-5f78-46c0-8e35-741a1444d3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.676764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662172-5f78-46c0-8e35-741a1444d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.677105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1662172-5f78-46c0-8e35-741a1444d3c9 admin admin] PATH_INFO: `/v3/projects/11ad64bf66f149b5900180b8c8d7420f/users/3e186a9c07fa486a9aa747e2e3185cb8/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.679450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1662172-5f78-46c0-8e35-741a1444d3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ad64bf66f149b5900180b8c8d7420f, user_id=3e186a9c07fa486a9aa747e2e3185cb8, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:02.683056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1662172-5f78-46c0-8e35-741a1444d3c9 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:02.695846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1101/2176] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:02 2022] PUT /identity/v3/projects/11ad64bf66f149b5900180b8c8d7420f/users/3e186a9c07fa486a9aa747e2e3185cb8/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:17:02.709932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ec806aee-225f-4f38-bf61-22832150d753 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:02.711237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ec806aee-225f-4f38-bf61-22832150d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:02.807638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1076/2177] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:02.816455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc8e7-7bfe-4e30-9981-aa058917c630 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.816801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc8e7-7bfe-4e30-9981-aa058917c630 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.817101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc8e7-7bfe-4e30-9981-aa058917c630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.837466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3b8cc8e7-7bfe-4e30-9981-aa058917c630 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:02.839387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3b8cc8e7-7bfe-4e30-9981-aa058917c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:02.859277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1102/2178] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:02.863438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806aee-225f-4f38-bf61-22832150d753 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:02.874904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec806aee-225f-4f38-bf61-22832150d753 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:02.880413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd78d20-230e-44b0-9102-fe696371673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:02.881204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd78d20-230e-44b0-9102-fe696371673c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.881487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd78d20-230e-44b0-9102-fe696371673c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.881759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd78d20-230e-44b0-9102-fe696371673c admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.882820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd78d20-230e-44b0-9102-fe696371673c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:17:02.883282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd78d20-230e-44b0-9102-fe696371673c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:02.885001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd78d20-230e-44b0-9102-fe696371673c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:02.898291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1077/2179] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:17:02.903407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc8e7-7bfe-4e30-9981-aa058917c630 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:02.913981 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc8e7-7bfe-4e30-9981-aa058917c630 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:02.919876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb16a6-6058-488d-8720-ca476114c87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:02.920571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb16a6-6058-488d-8720-ca476114c87d admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:02.920800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb16a6-6058-488d-8720-ca476114c87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:02.921069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb16a6-6058-488d-8720-ca476114c87d admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:02.921881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb16a6-6058-488d-8720-ca476114c87d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:02.924534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb16a6-6058-488d-8720-ca476114c87d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:03.072478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1103/2180] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:02 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:03.082520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd78d20-230e-44b0-9102-fe696371673c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:03.093886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd78d20-230e-44b0-9102-fe696371673c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:03.196512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d956b-a8c2-41ad-8aef-8b13141ef42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:03.197188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d956b-a8c2-41ad-8aef-8b13141ef42c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:03.197467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d956b-a8c2-41ad-8aef-8b13141ef42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:03.197739 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d956b-a8c2-41ad-8aef-8b13141ef42c admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:03.199096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d956b-a8c2-41ad-8aef-8b13141ef42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:03.201108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d956b-a8c2-41ad-8aef-8b13141ef42c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:03.276785 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1078/2181] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:03 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:17:03.281301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb16a6-6058-488d-8720-ca476114c87d admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:03.294494 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb16a6-6058-488d-8720-ca476114c87d admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:03.303068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4443259-ee23-49bd-8015-097887d2c07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:03.304228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4443259-ee23-49bd-8015-097887d2c07e admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:03.304517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4443259-ee23-49bd-8015-097887d2c07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:03.304844 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4443259-ee23-49bd-8015-097887d2c07e admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:03.305583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4443259-ee23-49bd-8015-097887d2c07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:03.308116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4443259-ee23-49bd-8015-097887d2c07e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:03.325069 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d956b-a8c2-41ad-8aef-8b13141ef42c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:03.325917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1104/2182] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:03.350836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d956b-a8c2-41ad-8aef-8b13141ef42c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:03.367727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9530b1-e83c-443c-8556-45cbde0b3cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:03.368817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9530b1-e83c-443c-8556-45cbde0b3cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:03.369282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9530b1-e83c-443c-8556-45cbde0b3cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:03.369789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9530b1-e83c-443c-8556-45cbde0b3cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:03.371211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9530b1-e83c-443c-8556-45cbde0b3cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:03.373265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9530b1-e83c-443c-8556-45cbde0b3cfb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:03.401677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1079/2183] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:17:03.406705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4443259-ee23-49bd-8015-097887d2c07e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:03.420368 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4443259-ee23-49bd-8015-097887d2c07e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:03.447489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1d89f-5e5e-45ce-84c7-ca9cc359fb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:03.448414 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d89f-5e5e-45ce-84c7-ca9cc359fb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:03.449333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d89f-5e5e-45ce-84c7-ca9cc359fb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:03.449762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d89f-5e5e-45ce-84c7-ca9cc359fb0e admin admin] PATH_INFO: `/v3/projects/3759cd554fee46c2be5fc6eb3bcaf609/users/1abb9dc022aa48bf9b3fa508756230c6/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:03.475436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1d89f-5e5e-45ce-84c7-ca9cc359fb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3759cd554fee46c2be5fc6eb3bcaf609, user_id=1abb9dc022aa48bf9b3fa508756230c6, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:03.478369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1d89f-5e5e-45ce-84c7-ca9cc359fb0e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:03.586919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1105/2184] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:03 2022] PUT /identity/v3/projects/3759cd554fee46c2be5fc6eb3bcaf609/users/1abb9dc022aa48bf9b3fa508756230c6/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:03.598216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17e347-e757-442c-922b-3e5bb63c17fd None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:03.598716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17e347-e757-442c-922b-3e5bb63c17fd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:03.599157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17e347-e757-442c-922b-3e5bb63c17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:03.644997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2f17e347-e757-442c-922b-3e5bb63c17fd None None] MFA Rules not processed for user `1abb9dc022aa48bf9b3fa508756230c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:03.647956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2f17e347-e757-442c-922b-3e5bb63c17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:03.812340 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1080/2185] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:03.814362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1d89f-5e5e-45ce-84c7-ca9cc359fb0e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:03.956072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1d89f-5e5e-45ce-84c7-ca9cc359fb0e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:03.961101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d0347-0e98-4584-9b68-3b19623789a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:03.961982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d0347-0e98-4584-9b68-3b19623789a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:03.962316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d0347-0e98-4584-9b68-3b19623789a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:03.962601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d0347-0e98-4584-9b68-3b19623789a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:03.964585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d0347-0e98-4584-9b68-3b19623789a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:03.966809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d0347-0e98-4584-9b68-3b19623789a7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:04.054018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1106/2186] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:03 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:04.055844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17e347-e757-442c-922b-3e5bb63c17fd None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:04.071382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17e347-e757-442c-922b-3e5bb63c17fd None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:04.180518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c968b8f-c5d6-42ac-8c9a-2e51a590b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:04.181677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c968b8f-c5d6-42ac-8c9a-2e51a590b4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:04.181963 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c968b8f-c5d6-42ac-8c9a-2e51a590b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:04.182846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c968b8f-c5d6-42ac-8c9a-2e51a590b4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:04.183546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c968b8f-c5d6-42ac-8c9a-2e51a590b4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:04.192118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c968b8f-c5d6-42ac-8c9a-2e51a590b4c6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:04.307310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1081/2187] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:04 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:04.312172 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d0347-0e98-4584-9b68-3b19623789a7 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:04.328858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d0347-0e98-4584-9b68-3b19623789a7 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:04.352674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f7ad8-ebef-42e2-907d-b912ebce84b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:04.353457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7ad8-ebef-42e2-907d-b912ebce84b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:04.353856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7ad8-ebef-42e2-907d-b912ebce84b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:04.354257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7ad8-ebef-42e2-907d-b912ebce84b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:04.355086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f7ad8-ebef-42e2-907d-b912ebce84b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:04.360062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f7ad8-ebef-42e2-907d-b912ebce84b7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:04.389440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1107/2188] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:04.391721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c968b8f-c5d6-42ac-8c9a-2e51a590b4c6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:04.419299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c968b8f-c5d6-42ac-8c9a-2e51a590b4c6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:04.434637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c85c4-9ad8-4077-a9c5-240499478605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:04.435567 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c85c4-9ad8-4077-a9c5-240499478605 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:04.436088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c85c4-9ad8-4077-a9c5-240499478605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:04.436696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c85c4-9ad8-4077-a9c5-240499478605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:04.438844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c85c4-9ad8-4077-a9c5-240499478605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:04.441743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c85c4-9ad8-4077-a9c5-240499478605 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:04.469274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1082/2189] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:04.473241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f7ad8-ebef-42e2-907d-b912ebce84b7 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:04.483395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f7ad8-ebef-42e2-907d-b912ebce84b7 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:04.491330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcc919-5b92-4e39-9440-44b61cf85d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:04.492307 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcc919-5b92-4e39-9440-44b61cf85d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:04.492582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcc919-5b92-4e39-9440-44b61cf85d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:04.492848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcc919-5b92-4e39-9440-44b61cf85d68 admin admin] PATH_INFO: `/v3/projects/8e1f9633e3ed4c24a9cb88407bf1462f/users/835d74261ac0420db2d654403b7898c6/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:04.509856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcc919-5b92-4e39-9440-44b61cf85d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1f9633e3ed4c24a9cb88407bf1462f, user_id=835d74261ac0420db2d654403b7898c6, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:04.513992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcc919-5b92-4e39-9440-44b61cf85d68 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:04.645554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1108/2190] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:04 2022] PUT /identity/v3/projects/8e1f9633e3ed4c24a9cb88407bf1462f/users/835d74261ac0420db2d654403b7898c6/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:04.659830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b3a4c-b1ab-4089-a777-837eb91ec8b8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:04.660114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b3a4c-b1ab-4089-a777-837eb91ec8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:04.660394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b3a4c-b1ab-4089-a777-837eb91ec8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:04.696418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-823b3a4c-b1ab-4089-a777-837eb91ec8b8 None None] MFA Rules not processed for user `835d74261ac0420db2d654403b7898c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:04.698085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-823b3a4c-b1ab-4089-a777-837eb91ec8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:04.816196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1083/2191] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:04.821051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcc919-5b92-4e39-9440-44b61cf85d68 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:04.905695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcc919-5b92-4e39-9440-44b61cf85d68 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:04.913877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ac857-664f-4c06-ad5d-cd9ec9c11a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:04.914709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ac857-664f-4c06-ad5d-cd9ec9c11a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:04.915503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ac857-664f-4c06-ad5d-cd9ec9c11a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:04.915503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ac857-664f-4c06-ad5d-cd9ec9c11a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:04.916332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ac857-664f-4c06-ad5d-cd9ec9c11a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:04.919070 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ac857-664f-4c06-ad5d-cd9ec9c11a4d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:05.040206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1109/2192] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:04 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:05.044777 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b3a4c-b1ab-4089-a777-837eb91ec8b8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:05.066592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b3a4c-b1ab-4089-a777-837eb91ec8b8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:05.187020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e441c7-a382-4074-9fce-cdb71e4d5276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:05.188213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e441c7-a382-4074-9fce-cdb71e4d5276 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:05.190384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e441c7-a382-4074-9fce-cdb71e4d5276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:05.190384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e441c7-a382-4074-9fce-cdb71e4d5276 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:05.190947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e441c7-a382-4074-9fce-cdb71e4d5276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:05.193554 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e441c7-a382-4074-9fce-cdb71e4d5276 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:05.324678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ac857-664f-4c06-ad5d-cd9ec9c11a4d admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:05.327163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c17ac857-664f-4c06-ad5d-cd9ec9c11a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:05.334480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1084/2193] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:05 2022] POST /identity/v3/users => generated 296 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:05.339502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e441c7-a382-4074-9fce-cdb71e4d5276 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:05.343009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ac857-664f-4c06-ad5d-cd9ec9c11a4d admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:05.349400 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:05.350503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:05.350783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:05.351212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] PATH_INFO: `/v3/users/2289318f8dbb4bceb0f501ef45d70825` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:05.352567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2289318f8dbb4bceb0f501ef45d70825)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:05.355813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:05.364298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e441c7-a382-4074-9fce-cdb71e4d5276 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:05.372011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf67a6-370c-482c-a2b6-6a59e40d2133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:05.372890 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf67a6-370c-482c-a2b6-6a59e40d2133 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:05.373310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf67a6-370c-482c-a2b6-6a59e40d2133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:05.373595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf67a6-370c-482c-a2b6-6a59e40d2133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:05.376066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf67a6-370c-482c-a2b6-6a59e40d2133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:05.378136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf67a6-370c-482c-a2b6-6a59e40d2133 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:05.394282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1085/2194] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:17:05.395816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf67a6-370c-482c-a2b6-6a59e40d2133 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:05.407973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf67a6-370c-482c-a2b6-6a59e40d2133 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:05.413279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e616f03-2b2f-48cc-bd1f-a535fc7c65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:05.413846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e616f03-2b2f-48cc-bd1f-a535fc7c65e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:05.414168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e616f03-2b2f-48cc-bd1f-a535fc7c65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:05.414444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e616f03-2b2f-48cc-bd1f-a535fc7c65e5 admin admin] PATH_INFO: `/v3/projects/7f442da9812f41db97b29542a6cbe870/users/7dac1680604a4e298bc56dd30149b2d6/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:05.432896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e616f03-2b2f-48cc-bd1f-a535fc7c65e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f442da9812f41db97b29542a6cbe870, user_id=7dac1680604a4e298bc56dd30149b2d6, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:05.435970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e616f03-2b2f-48cc-bd1f-a535fc7c65e5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:05.582021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1086/2195] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:05 2022] PUT /identity/v3/projects/7f442da9812f41db97b29542a6cbe870/users/7dac1680604a4e298bc56dd30149b2d6/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:05.586698 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e616f03-2b2f-48cc-bd1f-a535fc7c65e5 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:05.620780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2289318f8dbb4bceb0f501ef45d70825'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:05.621866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2289318f8dbb4bceb0f501ef45d70825'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:05.628325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2289318f8dbb4bceb0f501ef45d70825'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:05.667733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2289318f8dbb4bceb0f501ef45d70825'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:05.676804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4773627-6db9-4a78-af8c-a2a66020f182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2289318f8dbb4bceb0f501ef45d70825'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:05.692880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e616f03-2b2f-48cc-bd1f-a535fc7c65e5 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:05.698986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cca5cf-5b63-4164-a82e-bf52a1ca3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:05.699834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cca5cf-5b63-4164-a82e-bf52a1ca3d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:05.700210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cca5cf-5b63-4164-a82e-bf52a1ca3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:05.700590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cca5cf-5b63-4164-a82e-bf52a1ca3d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:05.701462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cca5cf-5b63-4164-a82e-bf52a1ca3d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:05.703504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cca5cf-5b63-4164-a82e-bf52a1ca3d0c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:05.716023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1087/2196] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:05.719888 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cca5cf-5b63-4164-a82e-bf52a1ca3d0c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:05.721873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e8cca5cf-5b63-4164-a82e-bf52a1ca3d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:05.745226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cca5cf-5b63-4164-a82e-bf52a1ca3d0c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:05.752207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c7cb-a4b0-4bf4-b22a-db74cfdf703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:05.753273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c7cb-a4b0-4bf4-b22a-db74cfdf703b admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:05.753615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c7cb-a4b0-4bf4-b22a-db74cfdf703b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:05.753945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c7cb-a4b0-4bf4-b22a-db74cfdf703b admin admin] PATH_INFO: `/v3/projects/7f442da9812f41db97b29542a6cbe870/users/7dac1680604a4e298bc56dd30149b2d6/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:05.756408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1110/2197] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:05 2022] DELETE /identity/v3/users/2289318f8dbb4bceb0f501ef45d70825 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:05.756629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c7cb-a4b0-4bf4-b22a-db74cfdf703b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f442da9812f41db97b29542a6cbe870, user_id=7dac1680604a4e298bc56dd30149b2d6, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:05.757842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca45c3-b982-4f2c-9b87-b07385ad6549 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:05.758171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca45c3-b982-4f2c-9b87-b07385ad6549 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:05.758448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca45c3-b982-4f2c-9b87-b07385ad6549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:05.760853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c7cb-a4b0-4bf4-b22a-db74cfdf703b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:05.786101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1088/2198] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:05 2022] PUT /identity/v3/projects/7f442da9812f41db97b29542a6cbe870/users/7dac1680604a4e298bc56dd30149b2d6/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:05.788707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07682b9d-4639-4af8-8f5e-7b9bdbac1883 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:05.789222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07682b9d-4639-4af8-8f5e-7b9bdbac1883 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:05.789711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07682b9d-4639-4af8-8f5e-7b9bdbac1883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:05.798300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-feca45c3-b982-4f2c-9b87-b07385ad6549 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:05.801080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-feca45c3-b982-4f2c-9b87-b07385ad6549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:05.825925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-07682b9d-4639-4af8-8f5e-7b9bdbac1883 None None] MFA Rules not processed for user `7dac1680604a4e298bc56dd30149b2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:05.827349 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-07682b9d-4639-4af8-8f5e-7b9bdbac1883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:05.915755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1089/2199] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:05.923434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07682b9d-4639-4af8-8f5e-7b9bdbac1883 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:05.927782 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-07682b9d-4639-4af8-8f5e-7b9bdbac1883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:05.929163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1111/2200] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:05.941237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca45c3-b982-4f2c-9b87-b07385ad6549 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:05.947594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-feca45c3-b982-4f2c-9b87-b07385ad6549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:06.056741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca45c3-b982-4f2c-9b87-b07385ad6549 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:06.065669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4068e-f492-40bd-ae1b-cca94ba86668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:06.066740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4068e-f492-40bd-ae1b-cca94ba86668 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:06.067173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4068e-f492-40bd-ae1b-cca94ba86668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:06.067638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4068e-f492-40bd-ae1b-cca94ba86668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:06.090587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4068e-f492-40bd-ae1b-cca94ba86668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:06.092060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4068e-f492-40bd-ae1b-cca94ba86668 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:06.100217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07682b9d-4639-4af8-8f5e-7b9bdbac1883 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:06.105930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f20b64-47cc-4049-bcf0-0eb03e56f792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:06.106765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f20b64-47cc-4049-bcf0-0eb03e56f792 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:06.107723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f20b64-47cc-4049-bcf0-0eb03e56f792 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:06.113703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f20b64-47cc-4049-bcf0-0eb03e56f792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:06.116404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1112/2201] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:17:06.120543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f20b64-47cc-4049-bcf0-0eb03e56f792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:06.122607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f20b64-47cc-4049-bcf0-0eb03e56f792 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:06.148065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1090/2202] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:06.288582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4068e-f492-40bd-ae1b-cca94ba86668 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:06.290591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-aab4068e-f492-40bd-ae1b-cca94ba86668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:06.325369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4068e-f492-40bd-ae1b-cca94ba86668 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:06.330027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab082c4-fe6b-496c-9897-607e1bd9ff50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:06.331063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab082c4-fe6b-496c-9897-607e1bd9ff50 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:06.331548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab082c4-fe6b-496c-9897-607e1bd9ff50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:06.332002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab082c4-fe6b-496c-9897-607e1bd9ff50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:06.335020 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fab082c4-fe6b-496c-9897-607e1bd9ff50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:06.437636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab082c4-fe6b-496c-9897-607e1bd9ff50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:06.440998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab082c4-fe6b-496c-9897-607e1bd9ff50 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:06.454297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1113/2203] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:06.709400 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f20b64-47cc-4049-bcf0-0eb03e56f792 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:06.710863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-30f20b64-47cc-4049-bcf0-0eb03e56f792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:06.726868 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f20b64-47cc-4049-bcf0-0eb03e56f792 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:06.732586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:06.733798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:06.734373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:06.734853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] PATH_INFO: `/v3/projects/528a5c91268c4f669f9cd678fc4accf2` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:06.747299 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=528a5c91268c4f669f9cd678fc4accf2)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:06.749562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:06.891989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528a5c91268c4f669f9cd678fc4accf2', 'request_id': 'req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:06.914302 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528a5c91268c4f669f9cd678fc4accf2', 'request_id': 'req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:06.931235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528a5c91268c4f669f9cd678fc4accf2', 'request_id': 'req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:07.049379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] The token cache is being invalidate because project 528a5c91268c4f669f9cd678fc4accf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:07.049668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:07.050390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:07.052206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1091/2204] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:06 2022] DELETE /identity/v3/projects/528a5c91268c4f669f9cd678fc4accf2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:07.056078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab082c4-fe6b-496c-9897-607e1bd9ff50 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:07.068462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab082c4-fe6b-496c-9897-607e1bd9ff50 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:07.130925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:07.131803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:07.132081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:07.132507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] PATH_INFO: `/v3/users/2b1d0d3e694a4100be9d4204e72de4c2` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:07.133748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1d0d3e694a4100be9d4204e72de4c2)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:07.136042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:07.390447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1d0d3e694a4100be9d4204e72de4c2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:07.391224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1d0d3e694a4100be9d4204e72de4c2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:07.391770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1d0d3e694a4100be9d4204e72de4c2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:07.420559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1d0d3e694a4100be9d4204e72de4c2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:07.444619 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e5a5af7b-ead9-4017-867a-6020c88155e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1d0d3e694a4100be9d4204e72de4c2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:07.514078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1114/2205] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:07 2022] DELETE /identity/v3/users/2b1d0d3e694a4100be9d4204e72de4c2 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:17:08.216156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:08.221991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:08.277518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539afc7-d2e3-44ea-8ab2-6942b6a301e8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:08.392517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:08.393728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:08.394213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:08.394637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] PATH_INFO: `/v3/projects/ad5037759c7c4e91bc358d977a337c01` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:08.397162 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5037759c7c4e91bc358d977a337c01)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:08.401218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:08.581349 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5037759c7c4e91bc358d977a337c01', 'request_id': 'req-3e653086-abd3-44a9-a8c2-8fab88a43808'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:08.590773 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5037759c7c4e91bc358d977a337c01', 'request_id': 'req-3e653086-abd3-44a9-a8c2-8fab88a43808'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:08.598255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5037759c7c4e91bc358d977a337c01', 'request_id': 'req-3e653086-abd3-44a9-a8c2-8fab88a43808'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:08.684062 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] The token cache is being invalidate because project ad5037759c7c4e91bc358d977a337c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:08.685211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:08.687559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3e653086-abd3-44a9-a8c2-8fab88a43808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:08.692052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1092/2206] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:08 2022] DELETE /identity/v3/projects/ad5037759c7c4e91bc358d977a337c01 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:08.697026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460a62-ae37-43e4-887d-8c7b24a7a3ce None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:08.698597 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460a62-ae37-43e4-887d-8c7b24a7a3ce None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:08.699028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88460a62-ae37-43e4-887d-8c7b24a7a3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:08.729104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-88460a62-ae37-43e4-887d-8c7b24a7a3ce None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:08.730938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-88460a62-ae37-43e4-887d-8c7b24a7a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:08.809930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1115/2207] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:08.817549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480d7c5-3687-4b58-8253-dca7fef4ee45 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:08.817836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480d7c5-3687-4b58-8253-dca7fef4ee45 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:08.818397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480d7c5-3687-4b58-8253-dca7fef4ee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:08.841864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c480d7c5-3687-4b58-8253-dca7fef4ee45 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:08.843232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c480d7c5-3687-4b58-8253-dca7fef4ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:08.853373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1093/2208] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:08.858105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88460a62-ae37-43e4-887d-8c7b24a7a3ce None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:08.868143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88460a62-ae37-43e4-887d-8c7b24a7a3ce None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:08.876423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a6e9f-dade-4f76-b413-672c8bfbfe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:08.879608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a6e9f-dade-4f76-b413-672c8bfbfe52 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:08.879608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a6e9f-dade-4f76-b413-672c8bfbfe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:08.879608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a6e9f-dade-4f76-b413-672c8bfbfe52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:08.879608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a6e9f-dade-4f76-b413-672c8bfbfe52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:17:08.879608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a6e9f-dade-4f76-b413-672c8bfbfe52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:08.880560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a6e9f-dade-4f76-b413-672c8bfbfe52 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:08.892515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1116/2209] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:17:08.898095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480d7c5-3687-4b58-8253-dca7fef4ee45 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:08.909009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480d7c5-3687-4b58-8253-dca7fef4ee45 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:08.914468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131da76-4644-476b-ade8-6f99743f146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:08.915134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131da76-4644-476b-ade8-6f99743f146c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:08.915469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131da76-4644-476b-ade8-6f99743f146c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:08.915741 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131da76-4644-476b-ade8-6f99743f146c admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:08.916978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131da76-4644-476b-ade8-6f99743f146c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:08.918917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131da76-4644-476b-ade8-6f99743f146c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:09.019110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1094/2210] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:08 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:09.023219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a6e9f-dade-4f76-b413-672c8bfbfe52 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:09.037821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a6e9f-dade-4f76-b413-672c8bfbfe52 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:09.109974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e894b57-fbab-4ef8-a509-1ce41ab965ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:09.111067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e894b57-fbab-4ef8-a509-1ce41ab965ba admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:09.111507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e894b57-fbab-4ef8-a509-1ce41ab965ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:09.111805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e894b57-fbab-4ef8-a509-1ce41ab965ba admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:09.123107 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e894b57-fbab-4ef8-a509-1ce41ab965ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:09.125088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e894b57-fbab-4ef8-a509-1ce41ab965ba admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:09.237983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1117/2211] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:09 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:09.241868 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131da76-4644-476b-ade8-6f99743f146c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:09.252281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131da76-4644-476b-ade8-6f99743f146c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:09.257252 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df418-d1ae-4fa3-b9a9-4247d72084eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:09.258150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df418-d1ae-4fa3-b9a9-4247d72084eb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:09.258604 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df418-d1ae-4fa3-b9a9-4247d72084eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:09.270543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df418-d1ae-4fa3-b9a9-4247d72084eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:09.271348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24df418-d1ae-4fa3-b9a9-4247d72084eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:09.273021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24df418-d1ae-4fa3-b9a9-4247d72084eb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:09.300570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1095/2212] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:09.304697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e894b57-fbab-4ef8-a509-1ce41ab965ba admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:09.328756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e894b57-fbab-4ef8-a509-1ce41ab965ba admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:09.333874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6106e-e3cc-4dcf-80df-fd109d2a619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:09.334608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6106e-e3cc-4dcf-80df-fd109d2a619f admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:09.334890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6106e-e3cc-4dcf-80df-fd109d2a619f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:09.335165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6106e-e3cc-4dcf-80df-fd109d2a619f admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:09.336916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6106e-e3cc-4dcf-80df-fd109d2a619f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:09.339418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6106e-e3cc-4dcf-80df-fd109d2a619f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:09.354316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1118/2213] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:17:09.356101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df418-d1ae-4fa3-b9a9-4247d72084eb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:09.379420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df418-d1ae-4fa3-b9a9-4247d72084eb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:09.394948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba96ef7-9c74-49c7-a624-6fb2732827b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:09.396012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba96ef7-9c74-49c7-a624-6fb2732827b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:09.396641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba96ef7-9c74-49c7-a624-6fb2732827b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:09.397016 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba96ef7-9c74-49c7-a624-6fb2732827b6 admin admin] PATH_INFO: `/v3/projects/79f0e130d5f14de6b5a1a25050a70271/users/c597e484614b477ca8784ae6959c2efe/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:09.429737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba96ef7-9c74-49c7-a624-6fb2732827b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f0e130d5f14de6b5a1a25050a70271, user_id=c597e484614b477ca8784ae6959c2efe, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:09.433788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba96ef7-9c74-49c7-a624-6fb2732827b6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:09.522923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1096/2214] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:09 2022] PUT /identity/v3/projects/79f0e130d5f14de6b5a1a25050a70271/users/c597e484614b477ca8784ae6959c2efe/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:09.540049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3324c7-5d1c-41cd-8438-988ea9afcbd0 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:09.540407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3324c7-5d1c-41cd-8438-988ea9afcbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:09.540818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3324c7-5d1c-41cd-8438-988ea9afcbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:09.580702 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3c3324c7-5d1c-41cd-8438-988ea9afcbd0 None None] MFA Rules not processed for user `c597e484614b477ca8784ae6959c2efe`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:09.582536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3c3324c7-5d1c-41cd-8438-988ea9afcbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:09.711141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1119/2215] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:09.717626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba96ef7-9c74-49c7-a624-6fb2732827b6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:09.901043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba96ef7-9c74-49c7-a624-6fb2732827b6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:09.911338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1f9ac-277b-471d-a32d-472fdba19369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:09.912944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1f9ac-277b-471d-a32d-472fdba19369 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:09.913858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1f9ac-277b-471d-a32d-472fdba19369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:09.914474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1f9ac-277b-471d-a32d-472fdba19369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:09.919035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1f9ac-277b-471d-a32d-472fdba19369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:09.924319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1f9ac-277b-471d-a32d-472fdba19369 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:10.037211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1097/2216] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:09 2022] POST /identity/v3/projects => generated 389 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:10.043194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3324c7-5d1c-41cd-8438-988ea9afcbd0 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:10.056023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3324c7-5d1c-41cd-8438-988ea9afcbd0 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:10.152833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd018c9-0e60-4db1-960c-d3fe532faa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:10.153818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd018c9-0e60-4db1-960c-d3fe532faa8e admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:10.154515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd018c9-0e60-4db1-960c-d3fe532faa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:10.155024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd018c9-0e60-4db1-960c-d3fe532faa8e admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:10.155784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd018c9-0e60-4db1-960c-d3fe532faa8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:10.158223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd018c9-0e60-4db1-960c-d3fe532faa8e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:10.252417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1120/2217] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:10 2022] POST /identity/v3/users => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:10.256965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1f9ac-277b-471d-a32d-472fdba19369 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:10.271184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1f9ac-277b-471d-a32d-472fdba19369 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:10.279478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c06e5-33e8-4005-9ba1-7b1b65733521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:10.281011 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c06e5-33e8-4005-9ba1-7b1b65733521 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:10.282535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c06e5-33e8-4005-9ba1-7b1b65733521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:10.283058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c06e5-33e8-4005-9ba1-7b1b65733521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:10.284393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c06e5-33e8-4005-9ba1-7b1b65733521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:10.287110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c06e5-33e8-4005-9ba1-7b1b65733521 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:10.316829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1098/2218] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:17:10.324240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd018c9-0e60-4db1-960c-d3fe532faa8e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:10.345236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd018c9-0e60-4db1-960c-d3fe532faa8e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:10.362652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3402b2-cbbb-4a40-bb0a-7e3cc442aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:10.363713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3402b2-cbbb-4a40-bb0a-7e3cc442aad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:10.363812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3402b2-cbbb-4a40-bb0a-7e3cc442aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:10.364077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3402b2-cbbb-4a40-bb0a-7e3cc442aad8 admin admin] PATH_INFO: `/v3/projects/3c22e9ae89214ba19208e6403632b2b5/users/a4b24b25051e415caad5a3994a7b2fbe/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:10.399372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3402b2-cbbb-4a40-bb0a-7e3cc442aad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c22e9ae89214ba19208e6403632b2b5, user_id=a4b24b25051e415caad5a3994a7b2fbe, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:10.402929 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3402b2-cbbb-4a40-bb0a-7e3cc442aad8 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:10.551555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1121/2219] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:10 2022] PUT /identity/v3/projects/3c22e9ae89214ba19208e6403632b2b5/users/a4b24b25051e415caad5a3994a7b2fbe/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:10.555854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c06e5-33e8-4005-9ba1-7b1b65733521 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:10.568612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c06e5-33e8-4005-9ba1-7b1b65733521 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:10.657905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d351e-cbe3-424d-893f-a709521478b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:10.658925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d351e-cbe3-424d-893f-a709521478b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:10.660036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d351e-cbe3-424d-893f-a709521478b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:10.660313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d351e-cbe3-424d-893f-a709521478b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:10.661100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d351e-cbe3-424d-893f-a709521478b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:10.662979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d351e-cbe3-424d-893f-a709521478b1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:10.689770 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1099/2220] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:10.694019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3402b2-cbbb-4a40-bb0a-7e3cc442aad8 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:10.727724 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3402b2-cbbb-4a40-bb0a-7e3cc442aad8 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:10.743943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b5b89-50ea-4492-92a1-a3e77d927b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:10.745680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b5b89-50ea-4492-92a1-a3e77d927b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:10.747180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b5b89-50ea-4492-92a1-a3e77d927b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:10.747611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b5b89-50ea-4492-92a1-a3e77d927b90 admin admin] PATH_INFO: `/v3/projects/3c22e9ae89214ba19208e6403632b2b5/users/a4b24b25051e415caad5a3994a7b2fbe/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:10.753342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b5b89-50ea-4492-92a1-a3e77d927b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c22e9ae89214ba19208e6403632b2b5, user_id=a4b24b25051e415caad5a3994a7b2fbe, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:10.756198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b5b89-50ea-4492-92a1-a3e77d927b90 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:10.779301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1122/2221] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:10 2022] PUT /identity/v3/projects/3c22e9ae89214ba19208e6403632b2b5/users/a4b24b25051e415caad5a3994a7b2fbe/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:10.799695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66a1d4-f48a-4f71-9395-0171d6393ec5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:10.799695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66a1d4-f48a-4f71-9395-0171d6393ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:10.800379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66a1d4-f48a-4f71-9395-0171d6393ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:10.828158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313505fe-80ba-4c59-b25e-24096b053d9f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:10.828586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313505fe-80ba-4c59-b25e-24096b053d9f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:10.829019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313505fe-80ba-4c59-b25e-24096b053d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:10.848940 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-da66a1d4-f48a-4f71-9395-0171d6393ec5 None None] MFA Rules not processed for user `a4b24b25051e415caad5a3994a7b2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:10.850089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-da66a1d4-f48a-4f71-9395-0171d6393ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:10.872312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-313505fe-80ba-4c59-b25e-24096b053d9f None None] MFA Rules not processed for user `3e186a9c07fa486a9aa747e2e3185cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:10.873542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-313505fe-80ba-4c59-b25e-24096b053d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:10.961546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1123/2222] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:10.993910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313505fe-80ba-4c59-b25e-24096b053d9f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:10.998187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-313505fe-80ba-4c59-b25e-24096b053d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:11.043541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1100/2223] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:11.088951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313505fe-80ba-4c59-b25e-24096b053d9f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:11.088951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2942c7-12bc-44ed-a5be-be78ac4b221f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9237b353da546989b399ee9702d1bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:11.088951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2942c7-12bc-44ed-a5be-be78ac4b221f service glance] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:11.088951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2942c7-12bc-44ed-a5be-be78ac4b221f service glance] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:11.089437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2942c7-12bc-44ed-a5be-be78ac4b221f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:11.090152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5e2942c7-12bc-44ed-a5be-be78ac4b221f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:11.148244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2942c7-12bc-44ed-a5be-be78ac4b221f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:11.149676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2942c7-12bc-44ed-a5be-be78ac4b221f service glance] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:11.158287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1124/2224] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:17:11.254317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66a1d4-f48a-4f71-9395-0171d6393ec5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:11.255681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-da66a1d4-f48a-4f71-9395-0171d6393ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:11.312267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66a1d4-f48a-4f71-9395-0171d6393ec5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:11.316846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eb974-1ee8-4a73-a186-4fc139fdf8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:11.317614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb974-1ee8-4a73-a186-4fc139fdf8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:11.318193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb974-1ee8-4a73-a186-4fc139fdf8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:11.318469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb974-1ee8-4a73-a186-4fc139fdf8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:11.336216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eb974-1ee8-4a73-a186-4fc139fdf8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:11.337882 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eb974-1ee8-4a73-a186-4fc139fdf8f5 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:11.347839 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1101/2225] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:11.539028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0bbc-170e-4884-94dd-3cfd7fb4821a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:11.547336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eb974-1ee8-4a73-a186-4fc139fdf8f5 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:11.549912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0bbc-170e-4884-94dd-3cfd7fb4821a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:11.550701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0bbc-170e-4884-94dd-3cfd7fb4821a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:11.580914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-487c0bbc-170e-4884-94dd-3cfd7fb4821a None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:11.583695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-487c0bbc-170e-4884-94dd-3cfd7fb4821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:11.629443 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eb974-1ee8-4a73-a186-4fc139fdf8f5 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:11.646740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:11.648815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:11.648815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:11.648815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] PATH_INFO: `/v3/users/c597e484614b477ca8784ae6959c2efe` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:11.651746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c597e484614b477ca8784ae6959c2efe)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:11.654195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:11.666665 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1125/2226] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:17:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:11.714712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0bbc-170e-4884-94dd-3cfd7fb4821a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:11.716163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-487c0bbc-170e-4884-94dd-3cfd7fb4821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:11.788076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0bbc-170e-4884-94dd-3cfd7fb4821a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:11.793938 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962992ce-9afc-4c63-a6dc-e64e606cd37a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:11.794618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962992ce-9afc-4c63-a6dc-e64e606cd37a service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:11.794899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962992ce-9afc-4c63-a6dc-e64e606cd37a service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:11.795192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962992ce-9afc-4c63-a6dc-e64e606cd37a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:11.803330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962992ce-9afc-4c63-a6dc-e64e606cd37a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:11.804899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962992ce-9afc-4c63-a6dc-e64e606cd37a service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:11.812953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1126/2227] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:17:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:17:11.872314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c597e484614b477ca8784ae6959c2efe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:11.873072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c597e484614b477ca8784ae6959c2efe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:11.891476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c597e484614b477ca8784ae6959c2efe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:11.892218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c597e484614b477ca8784ae6959c2efe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:11.909705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c597e484614b477ca8784ae6959c2efe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:12.064823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1102/2228] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:11 2022] DELETE /identity/v3/users/c597e484614b477ca8784ae6959c2efe => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:17:12.066559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c1568-b4a2-4944-86c8-9076208e0d9d None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:12.066857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c1568-b4a2-4944-86c8-9076208e0d9d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:12.067170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c1568-b4a2-4944-86c8-9076208e0d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:12.117120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-0d3c1568-b4a2-4944-86c8-9076208e0d9d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:12.118387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0d3c1568-b4a2-4944-86c8-9076208e0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:12.210405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1127/2229] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:12.220470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:12.221917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:12.412184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1bc3-2328-4e4d-8a56-a3a1287f8a39 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:12.412184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469670-a392-471b-860d-0172870214da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:12.412184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469670-a392-471b-860d-0172870214da service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:12.412184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469670-a392-471b-860d-0172870214da service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:12.413139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469670-a392-471b-860d-0172870214da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:12.413139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469670-a392-471b-860d-0172870214da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:12.413139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469670-a392-471b-860d-0172870214da service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:12.413139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1103/2230] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:12.918360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c1568-b4a2-4944-86c8-9076208e0d9d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:12.918360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0d3c1568-b4a2-4944-86c8-9076208e0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:12.933265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c1568-b4a2-4944-86c8-9076208e0d9d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:12.955918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:12.956961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:12.957236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:12.957527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] PATH_INFO: `/v3/users/1abb9dc022aa48bf9b3fa508756230c6` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:12.959172 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abb9dc022aa48bf9b3fa508756230c6)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:12.963632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:13.229988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469670-a392-471b-860d-0172870214da service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:13.232101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2c469670-a392-471b-860d-0172870214da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:13.260210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469670-a392-471b-860d-0172870214da service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:13.268278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:13.269986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:13.270580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:13.271089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] PATH_INFO: `/v3/projects/79f0e130d5f14de6b5a1a25050a70271` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:13.272633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f0e130d5f14de6b5a1a25050a70271)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:13.276007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:13.305296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abb9dc022aa48bf9b3fa508756230c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.310721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abb9dc022aa48bf9b3fa508756230c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.310721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abb9dc022aa48bf9b3fa508756230c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.320429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abb9dc022aa48bf9b3fa508756230c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.328413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7c9617e8-1d33-4d95-a1db-7c087b0e08bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abb9dc022aa48bf9b3fa508756230c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.475310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1128/2231] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:12 2022] DELETE /identity/v3/users/1abb9dc022aa48bf9b3fa508756230c6 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:13.477094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b1ae6-1ef6-4f67-b763-8b0ab9b0f066 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:13.477611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b1ae6-1ef6-4f67-b763-8b0ab9b0f066 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:13.478125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b1ae6-1ef6-4f67-b763-8b0ab9b0f066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:13.488934 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f0e130d5f14de6b5a1a25050a70271', 'request_id': 'req-36070790-9424-49d1-96fe-9429718a44f4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.500303 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f0e130d5f14de6b5a1a25050a70271', 'request_id': 'req-36070790-9424-49d1-96fe-9429718a44f4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.507644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f0e130d5f14de6b5a1a25050a70271', 'request_id': 'req-36070790-9424-49d1-96fe-9429718a44f4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.570696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-4c5b1ae6-1ef6-4f67-b763-8b0ab9b0f066 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:13.575255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4c5b1ae6-1ef6-4f67-b763-8b0ab9b0f066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:13.589343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] The token cache is being invalidate because project 79f0e130d5f14de6b5a1a25050a70271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:13.589629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.590475 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.592496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1104/2232] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:13 2022] DELETE /identity/v3/projects/79f0e130d5f14de6b5a1a25050a70271 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:17:13.596535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:13.600275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:13.669349 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1129/2233] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:13.685185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b1ae6-1ef6-4f67-b763-8b0ab9b0f066 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:13.686816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4c5b1ae6-1ef6-4f67-b763-8b0ab9b0f066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:13.743307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36070790-9424-49d1-96fe-9429718a44f4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:13.756960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:13.757858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:13.758182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:13.758459 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] PATH_INFO: `/v3/users/a4b24b25051e415caad5a3994a7b2fbe` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:13.759725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b24b25051e415caad5a3994a7b2fbe)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:13.761669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:13.771223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b1ae6-1ef6-4f67-b763-8b0ab9b0f066 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:13.781815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803bf85-b5de-419c-ae71-476891968a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:13.782728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803bf85-b5de-419c-ae71-476891968a8d service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:13.783013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803bf85-b5de-419c-ae71-476891968a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:13.783336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803bf85-b5de-419c-ae71-476891968a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:13.800661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803bf85-b5de-419c-ae71-476891968a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:13.802220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803bf85-b5de-419c-ae71-476891968a8d service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:13.818348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1130/2234] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:17:13.979287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b24b25051e415caad5a3994a7b2fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:13.980175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b24b25051e415caad5a3994a7b2fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:14.003617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b24b25051e415caad5a3994a7b2fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:14.004440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b24b25051e415caad5a3994a7b2fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:14.013525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b24b25051e415caad5a3994a7b2fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:14.106545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1105/2235] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:13 2022] DELETE /identity/v3/users/a4b24b25051e415caad5a3994a7b2fbe => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:14.373984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803bf85-b5de-419c-ae71-476891968a8d service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:14.385397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d803bf85-b5de-419c-ae71-476891968a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:14.396232 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803bf85-b5de-419c-ae71-476891968a8d service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:14.484533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:14.485332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:14.485641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:14.485917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] PATH_INFO: `/v3/projects/3759cd554fee46c2be5fc6eb3bcaf609` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:14.487315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3759cd554fee46c2be5fc6eb3bcaf609)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:14.489240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:14.689931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:14.691535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:14.699940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3759cd554fee46c2be5fc6eb3bcaf609', 'request_id': 'req-0fd72a8b-02f7-4b9f-b976-07051a56efa3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:14.751438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5e8eb-0073-48f2-bb42-c75d5dfdbdbf admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:14.778714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3759cd554fee46c2be5fc6eb3bcaf609', 'request_id': 'req-0fd72a8b-02f7-4b9f-b976-07051a56efa3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:14.785087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3759cd554fee46c2be5fc6eb3bcaf609', 'request_id': 'req-0fd72a8b-02f7-4b9f-b976-07051a56efa3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:14.819235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] The token cache is being invalidate because project 3759cd554fee46c2be5fc6eb3bcaf609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:14.820035 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:14.821238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:14.823894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1131/2236] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:14 2022] DELETE /identity/v3/projects/3759cd554fee46c2be5fc6eb3bcaf609 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:14.827754 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:14.834048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:14.903875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:14.904753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:14.905033 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:14.905308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] PATH_INFO: `/v3/projects/3c22e9ae89214ba19208e6403632b2b5` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:14.909749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c22e9ae89214ba19208e6403632b2b5)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:14.911970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:14.977558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd72a8b-02f7-4b9f-b976-07051a56efa3 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:14.991518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:14.992407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:14.992687 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:14.992960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] PATH_INFO: `/v3/users/835d74261ac0420db2d654403b7898c6` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:14.996799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=835d74261ac0420db2d654403b7898c6)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:15.005666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:15.081624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c22e9ae89214ba19208e6403632b2b5', 'request_id': 'req-78e1a598-8da5-41df-b39b-da0e50abe020'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.093390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c22e9ae89214ba19208e6403632b2b5', 'request_id': 'req-78e1a598-8da5-41df-b39b-da0e50abe020'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.101482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c22e9ae89214ba19208e6403632b2b5', 'request_id': 'req-78e1a598-8da5-41df-b39b-da0e50abe020'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.236797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] The token cache is being invalidate because project 3c22e9ae89214ba19208e6403632b2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:15.236797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.236797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78e1a598-8da5-41df-b39b-da0e50abe020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.236797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1106/2237] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:14 2022] DELETE /identity/v3/projects/3c22e9ae89214ba19208e6403632b2b5 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:15.249617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deaaf8-b523-4ef3-8aea-bae599b6682d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:15.249854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deaaf8-b523-4ef3-8aea-bae599b6682d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:15.250362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deaaf8-b523-4ef3-8aea-bae599b6682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:15.341989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d4deaaf8-b523-4ef3-8aea-bae599b6682d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:15.344640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d4deaaf8-b523-4ef3-8aea-bae599b6682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:15.379659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835d74261ac0420db2d654403b7898c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.392642 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835d74261ac0420db2d654403b7898c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.393707 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835d74261ac0420db2d654403b7898c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.415928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835d74261ac0420db2d654403b7898c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.425750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835d74261ac0420db2d654403b7898c6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:15.504694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1107/2238] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:15.513394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e30a2-cbb0-4ac9-9360-fa5446d896a6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:15.513742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e30a2-cbb0-4ac9-9360-fa5446d896a6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:15.513957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e30a2-cbb0-4ac9-9360-fa5446d896a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:15.515787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1132/2239] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:14 2022] DELETE /identity/v3/users/835d74261ac0420db2d654403b7898c6 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:15.556904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a17e30a2-cbb0-4ac9-9360-fa5446d896a6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:15.558192 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a17e30a2-cbb0-4ac9-9360-fa5446d896a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:15.676406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1108/2240] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:15.680778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:15.693933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c006a3-a634-4733-8905-12cad8f818ae admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:15.706018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e668ad-d4ff-4671-85be-b4344747828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:15.706993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e668ad-d4ff-4671-85be-b4344747828b admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:15.707439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e668ad-d4ff-4671-85be-b4344747828b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:15.707873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e668ad-d4ff-4671-85be-b4344747828b admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:15.709821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e668ad-d4ff-4671-85be-b4344747828b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:17:15.710755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e668ad-d4ff-4671-85be-b4344747828b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:15.714568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e668ad-d4ff-4671-85be-b4344747828b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:15.734155 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1133/2241] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:17:15.739327 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e30a2-cbb0-4ac9-9360-fa5446d896a6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:15.755328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e30a2-cbb0-4ac9-9360-fa5446d896a6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:15.760992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787c8b2-27c5-4042-87ae-d5228db13851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:15.761738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787c8b2-27c5-4042-87ae-d5228db13851 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:15.762473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787c8b2-27c5-4042-87ae-d5228db13851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:15.772743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787c8b2-27c5-4042-87ae-d5228db13851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:15.772743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787c8b2-27c5-4042-87ae-d5228db13851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:15.772743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787c8b2-27c5-4042-87ae-d5228db13851 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:15.865108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1109/2242] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:15 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:17:15.876187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e668ad-d4ff-4671-85be-b4344747828b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:15.893928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e668ad-d4ff-4671-85be-b4344747828b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:16.066649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a70de4-7ddc-4fdd-9a4c-72c9efbbb131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:16.067329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a70de4-7ddc-4fdd-9a4c-72c9efbbb131 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:16.067624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a70de4-7ddc-4fdd-9a4c-72c9efbbb131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:16.068140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a70de4-7ddc-4fdd-9a4c-72c9efbbb131 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:16.068838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a70de4-7ddc-4fdd-9a4c-72c9efbbb131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:16.070827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a70de4-7ddc-4fdd-9a4c-72c9efbbb131 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:16.194491 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787c8b2-27c5-4042-87ae-d5228db13851 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:16.202696 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f787c8b2-27c5-4042-87ae-d5228db13851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:16.247690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1134/2243] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:15 2022] POST /identity/v3/users => generated 285 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:16.247690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a70de4-7ddc-4fdd-9a4c-72c9efbbb131 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:16.267508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787c8b2-27c5-4042-87ae-d5228db13851 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:16.270166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a70de4-7ddc-4fdd-9a4c-72c9efbbb131 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:16.274576 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:16.276471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:16.276835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:16.277181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] PATH_INFO: `/v3/projects/8e1f9633e3ed4c24a9cb88407bf1462f` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:16.277523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c560c-adcf-4afe-9cf9-a3abca2e70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:16.278344 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c560c-adcf-4afe-9cf9-a3abca2e70b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:16.278732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c560c-adcf-4afe-9cf9-a3abca2e70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:16.278851 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1f9633e3ed4c24a9cb88407bf1462f)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:16.279186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c560c-adcf-4afe-9cf9-a3abca2e70b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:16.280080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c560c-adcf-4afe-9cf9-a3abca2e70b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:16.282099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c560c-adcf-4afe-9cf9-a3abca2e70b0 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:16.283008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:16.301407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1135/2244] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:17:16.302726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c560c-adcf-4afe-9cf9-a3abca2e70b0 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:16.316473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c560c-adcf-4afe-9cf9-a3abca2e70b0 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:16.326465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6506c-3bad-4304-8c29-b2cd7c0d0563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:16.330881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6506c-3bad-4304-8c29-b2cd7c0d0563 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:16.330881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6506c-3bad-4304-8c29-b2cd7c0d0563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:16.330881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6506c-3bad-4304-8c29-b2cd7c0d0563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:16.331379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6506c-3bad-4304-8c29-b2cd7c0d0563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:16.336869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c6506c-3bad-4304-8c29-b2cd7c0d0563 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:16.358463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1136/2245] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:16.363959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6506c-3bad-4304-8c29-b2cd7c0d0563 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:16.377726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6506c-3bad-4304-8c29-b2cd7c0d0563 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:16.383811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992e4d5-e5f0-4b01-a45f-9efba6983b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:16.385505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e4d5-e5f0-4b01-a45f-9efba6983b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:16.386193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e4d5-e5f0-4b01-a45f-9efba6983b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:16.386672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e4d5-e5f0-4b01-a45f-9efba6983b68 admin admin] PATH_INFO: `/v3/projects/7b8078c2370a471692860aaf4320c3f6/users/ded09237c4dd42d6aac26c7710c0a7b4/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:16.410364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992e4d5-e5f0-4b01-a45f-9efba6983b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8078c2370a471692860aaf4320c3f6, user_id=ded09237c4dd42d6aac26c7710c0a7b4, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:16.413009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992e4d5-e5f0-4b01-a45f-9efba6983b68 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:16.686230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1137/2246] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:16 2022] PUT /identity/v3/projects/7b8078c2370a471692860aaf4320c3f6/users/ded09237c4dd42d6aac26c7710c0a7b4/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:17:16.699110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1f9633e3ed4c24a9cb88407bf1462f', 'request_id': 'req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:16.700099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219c3a-cb9e-4262-8295-3f2d8bc50a34 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:16.700396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219c3a-cb9e-4262-8295-3f2d8bc50a34 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:16.700676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219c3a-cb9e-4262-8295-3f2d8bc50a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:16.707025 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1f9633e3ed4c24a9cb88407bf1462f', 'request_id': 'req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:16.718967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1f9633e3ed4c24a9cb88407bf1462f', 'request_id': 'req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:16.736780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-85219c3a-cb9e-4262-8295-3f2d8bc50a34 None None] MFA Rules not processed for user `ded09237c4dd42d6aac26c7710c0a7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:16.738890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-85219c3a-cb9e-4262-8295-3f2d8bc50a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:16.818828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] The token cache is being invalidate because project 8e1f9633e3ed4c24a9cb88407bf1462f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:16.819398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:16.822244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:16.828817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1110/2247] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:16 2022] DELETE /identity/v3/projects/8e1f9633e3ed4c24a9cb88407bf1462f => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:16.828817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:16.830687 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:16.834104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1138/2248] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:17:16.844428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219c3a-cb9e-4262-8295-3f2d8bc50a34 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:16.845977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-85219c3a-cb9e-4262-8295-3f2d8bc50a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:16.933863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219c3a-cb9e-4262-8295-3f2d8bc50a34 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:16.939448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aba996-e644-4a5b-8d57-49ea034eb974 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9237b353da546989b399ee9702d1bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:16.940115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aba996-e644-4a5b-8d57-49ea034eb974 service glance] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:16.940395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aba996-e644-4a5b-8d57-49ea034eb974 service glance] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:16.940666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aba996-e644-4a5b-8d57-49ea034eb974 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:16.945060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e8aba996-e644-4a5b-8d57-49ea034eb974 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:16.974937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aba996-e644-4a5b-8d57-49ea034eb974 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:16.974937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aba996-e644-4a5b-8d57-49ea034eb974 service glance] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:16.975205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbff0c9-5a9b-4153-b2cf-d35380a2c66c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:16.983242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1139/2249] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:17:16.986960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:16.987845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:16.988124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:16.988397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] PATH_INFO: `/v3/users/7dac1680604a4e298bc56dd30149b2d6` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:16.989640 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dac1680604a4e298bc56dd30149b2d6)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:16.997251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:17.244746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dac1680604a4e298bc56dd30149b2d6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:17.245886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dac1680604a4e298bc56dd30149b2d6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:17.265049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dac1680604a4e298bc56dd30149b2d6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:17.265919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dac1680604a4e298bc56dd30149b2d6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:17.276477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e0bd505f-7057-45a1-99b2-dc46a217adc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dac1680604a4e298bc56dd30149b2d6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:17.385732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1111/2250] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:16 2022] DELETE /identity/v3/users/7dac1680604a4e298bc56dd30149b2d6 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:17:18.257499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aba996-e644-4a5b-8d57-49ea034eb974 service glance] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:18.279118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aba996-e644-4a5b-8d57-49ea034eb974 service glance] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:18.405001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:18.406470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:18.406964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:18.407397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] PATH_INFO: `/v3/projects/7f442da9812f41db97b29542a6cbe870` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:18.408862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f442da9812f41db97b29542a6cbe870)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:18.411336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:18.522714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f442da9812f41db97b29542a6cbe870', 'request_id': 'req-4f652f6b-bd2b-467f-8128-655762f86381'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:18.602158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f442da9812f41db97b29542a6cbe870', 'request_id': 'req-4f652f6b-bd2b-467f-8128-655762f86381'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:18.610537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f442da9812f41db97b29542a6cbe870', 'request_id': 'req-4f652f6b-bd2b-467f-8128-655762f86381'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:18.624732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] The token cache is being invalidate because project 7f442da9812f41db97b29542a6cbe870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:18.625289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:18.626144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4f652f6b-bd2b-467f-8128-655762f86381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:18.628020 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1140/2251] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:18 2022] DELETE /identity/v3/projects/7f442da9812f41db97b29542a6cbe870 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:18.633919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49325e-7e88-4e52-9f14-131ab3eaf856 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:18.634902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49325e-7e88-4e52-9f14-131ab3eaf856 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:18.635009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49325e-7e88-4e52-9f14-131ab3eaf856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:18.662219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1a49325e-7e88-4e52-9f14-131ab3eaf856 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:18.663638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1a49325e-7e88-4e52-9f14-131ab3eaf856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:18.760099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1112/2252] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:18.763150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75339934-7cba-4596-a7f6-50138771bdb2 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:18.766548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75339934-7cba-4596-a7f6-50138771bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:18.766548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75339934-7cba-4596-a7f6-50138771bdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:18.789816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-75339934-7cba-4596-a7f6-50138771bdb2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:18.791632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-75339934-7cba-4596-a7f6-50138771bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:18.804737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1141/2253] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:18.808019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49325e-7e88-4e52-9f14-131ab3eaf856 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:18.825127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49325e-7e88-4e52-9f14-131ab3eaf856 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:18.831434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e80e8-5c08-4c38-acd9-979a19531079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:18.832297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e80e8-5c08-4c38-acd9-979a19531079 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:18.832581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e80e8-5c08-4c38-acd9-979a19531079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:18.834780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e80e8-5c08-4c38-acd9-979a19531079 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:18.835650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e80e8-5c08-4c38-acd9-979a19531079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:17:18.836046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e80e8-5c08-4c38-acd9-979a19531079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:18.838267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e80e8-5c08-4c38-acd9-979a19531079 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:18.851571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1113/2254] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:17:18.856153 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75339934-7cba-4596-a7f6-50138771bdb2 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:18.871747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75339934-7cba-4596-a7f6-50138771bdb2 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:18.877739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de828810-1354-4052-a4be-825f527d3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:18.878503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de828810-1354-4052-a4be-825f527d3ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:18.878902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de828810-1354-4052-a4be-825f527d3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:18.879186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de828810-1354-4052-a4be-825f527d3ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:18.879934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de828810-1354-4052-a4be-825f527d3ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:18.882022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de828810-1354-4052-a4be-825f527d3ed1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:19.017205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1142/2255] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:18 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:19.021382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e80e8-5c08-4c38-acd9-979a19531079 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:19.039969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e80e8-5c08-4c38-acd9-979a19531079 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:19.187980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76436f5-4b58-4e69-82a4-ee1e0cde98ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:19.189133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76436f5-4b58-4e69-82a4-ee1e0cde98ff admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:19.189613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76436f5-4b58-4e69-82a4-ee1e0cde98ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:19.193771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76436f5-4b58-4e69-82a4-ee1e0cde98ff admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:19.197203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76436f5-4b58-4e69-82a4-ee1e0cde98ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:19.197619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76436f5-4b58-4e69-82a4-ee1e0cde98ff admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:19.299172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1114/2256] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:19 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:19.303829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de828810-1354-4052-a4be-825f527d3ed1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:19.316986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de828810-1354-4052-a4be-825f527d3ed1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:19.331484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420d065-bab7-4a9b-9796-4d11d6ba9453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:19.332286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420d065-bab7-4a9b-9796-4d11d6ba9453 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:19.332661 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420d065-bab7-4a9b-9796-4d11d6ba9453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:19.333169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420d065-bab7-4a9b-9796-4d11d6ba9453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:19.334149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420d065-bab7-4a9b-9796-4d11d6ba9453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:19.336004 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420d065-bab7-4a9b-9796-4d11d6ba9453 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:19.349614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1143/2257] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:17:19.354869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76436f5-4b58-4e69-82a4-ee1e0cde98ff admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:19.368889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76436f5-4b58-4e69-82a4-ee1e0cde98ff admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:19.381667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1f14a-d6fd-4f4a-b32f-0ddb7fed28b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:19.382381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1f14a-d6fd-4f4a-b32f-0ddb7fed28b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:19.382666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1f14a-d6fd-4f4a-b32f-0ddb7fed28b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:19.382940 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1f14a-d6fd-4f4a-b32f-0ddb7fed28b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:19.384042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1f14a-d6fd-4f4a-b32f-0ddb7fed28b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:19.386496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1f14a-d6fd-4f4a-b32f-0ddb7fed28b1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:19.413861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420d065-bab7-4a9b-9796-4d11d6ba9453 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:19.435438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420d065-bab7-4a9b-9796-4d11d6ba9453 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:19.436110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1115/2258] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:19.442145 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb72a69-5bca-407a-8652-25e941697b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:19.448102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb72a69-5bca-407a-8652-25e941697b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:19.448378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb72a69-5bca-407a-8652-25e941697b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:19.448823 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb72a69-5bca-407a-8652-25e941697b64 admin admin] PATH_INFO: `/v3/projects/851018b96f7547b6be0bfbbbeb7d48a2/users/74c67d9ab7da4cf186f3dbae63f2c4cf/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:19.472868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb72a69-5bca-407a-8652-25e941697b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851018b96f7547b6be0bfbbbeb7d48a2, user_id=74c67d9ab7da4cf186f3dbae63f2c4cf, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:19.475838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb72a69-5bca-407a-8652-25e941697b64 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:19.628165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1144/2259] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:19 2022] PUT /identity/v3/projects/851018b96f7547b6be0bfbbbeb7d48a2/users/74c67d9ab7da4cf186f3dbae63f2c4cf/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:19.635003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc0851-a4ea-432f-b4f6-c2e57a0007dc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:19.635535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc0851-a4ea-432f-b4f6-c2e57a0007dc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:19.635535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc0851-a4ea-432f-b4f6-c2e57a0007dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:19.663094 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b9bc0851-a4ea-432f-b4f6-c2e57a0007dc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:19.666087 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b9bc0851-a4ea-432f-b4f6-c2e57a0007dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:19.734525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1116/2260] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:19.745526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb72a69-5bca-407a-8652-25e941697b64 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:19.749312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0cb72a69-5bca-407a-8652-25e941697b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:19.832905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb72a69-5bca-407a-8652-25e941697b64 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:19.842124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934de53-4634-45c8-b8ea-06259bfa9106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:19.843496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934de53-4634-45c8-b8ea-06259bfa9106 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:19.843496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934de53-4634-45c8-b8ea-06259bfa9106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:19.843727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934de53-4634-45c8-b8ea-06259bfa9106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:19.861169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934de53-4634-45c8-b8ea-06259bfa9106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:19.862937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934de53-4634-45c8-b8ea-06259bfa9106 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:19.882952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1145/2261] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:22.537226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86b99-c43c-463f-83a9-1e897a02701a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:22.537895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86b99-c43c-463f-83a9-1e897a02701a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:22.537895 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86b99-c43c-463f-83a9-1e897a02701a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:22.579758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3bd86b99-c43c-463f-83a9-1e897a02701a None None] MFA Rules not processed for user `74c67d9ab7da4cf186f3dbae63f2c4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:22.581775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3bd86b99-c43c-463f-83a9-1e897a02701a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:22.755458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1117/2262] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:22.760226 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934de53-4634-45c8-b8ea-06259bfa9106 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:22.783873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934de53-4634-45c8-b8ea-06259bfa9106 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:22.800776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38c32-d233-4c31-ada8-b31c23b90ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:22.801767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38c32-d233-4c31-ada8-b31c23b90ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:22.802314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38c32-d233-4c31-ada8-b31c23b90ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:22.802820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38c32-d233-4c31-ada8-b31c23b90ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:22.804374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc38c32-d233-4c31-ada8-b31c23b90ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:22.806796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc38c32-d233-4c31-ada8-b31c23b90ca5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:22.939679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1146/2263] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:22 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:22.943753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86b99-c43c-463f-83a9-1e897a02701a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:22.971917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86b99-c43c-463f-83a9-1e897a02701a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:23.107114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2453d4d-ece6-41de-b522-2666a6a8b718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:23.108103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2453d4d-ece6-41de-b522-2666a6a8b718 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:23.115862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2453d4d-ece6-41de-b522-2666a6a8b718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:23.115862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2453d4d-ece6-41de-b522-2666a6a8b718 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:23.115862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2453d4d-ece6-41de-b522-2666a6a8b718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:23.115862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2453d4d-ece6-41de-b522-2666a6a8b718 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:23.200363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1118/2264] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:22 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:23.203472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38c32-d233-4c31-ada8-b31c23b90ca5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:23.223734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38c32-d233-4c31-ada8-b31c23b90ca5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:23.230388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23091ed0-26b4-4e84-a6c2-3c40cdeec00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:23.238888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23091ed0-26b4-4e84-a6c2-3c40cdeec00a admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:23.241746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23091ed0-26b4-4e84-a6c2-3c40cdeec00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:23.242329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23091ed0-26b4-4e84-a6c2-3c40cdeec00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:23.244658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23091ed0-26b4-4e84-a6c2-3c40cdeec00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:23.248480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23091ed0-26b4-4e84-a6c2-3c40cdeec00a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:23.273003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2453d4d-ece6-41de-b522-2666a6a8b718 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:23.282093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1147/2265] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:23.286632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2453d4d-ece6-41de-b522-2666a6a8b718 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:23.292419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761389ec-9381-4082-a44b-2ac37b05987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:23.294532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761389ec-9381-4082-a44b-2ac37b05987e admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:23.295005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761389ec-9381-4082-a44b-2ac37b05987e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:23.295373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761389ec-9381-4082-a44b-2ac37b05987e admin admin] PATH_INFO: `/v3/projects/8b39fcac70a3431f963ad2162d495b8a/users/26df1f0741044871b47cc0cc498e1689/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:23.326005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761389ec-9381-4082-a44b-2ac37b05987e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b39fcac70a3431f963ad2162d495b8a, user_id=26df1f0741044871b47cc0cc498e1689, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:23.329067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761389ec-9381-4082-a44b-2ac37b05987e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:23.428760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1119/2266] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:23 2022] PUT /identity/v3/projects/8b39fcac70a3431f963ad2162d495b8a/users/26df1f0741044871b47cc0cc498e1689/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:23.437384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23091ed0-26b4-4e84-a6c2-3c40cdeec00a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:23.446637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23091ed0-26b4-4e84-a6c2-3c40cdeec00a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:23.534557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb74d48-77d8-4317-95d4-5d2dcee96721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:23.535597 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74d48-77d8-4317-95d4-5d2dcee96721 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:23.536254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74d48-77d8-4317-95d4-5d2dcee96721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:23.536627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74d48-77d8-4317-95d4-5d2dcee96721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:23.537468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb74d48-77d8-4317-95d4-5d2dcee96721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:23.546699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb74d48-77d8-4317-95d4-5d2dcee96721 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:23.562697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1148/2267] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:23.563102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761389ec-9381-4082-a44b-2ac37b05987e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:23.585126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761389ec-9381-4082-a44b-2ac37b05987e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:23.591163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822460cb-5c43-4703-8049-24860112589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:23.592729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822460cb-5c43-4703-8049-24860112589d admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:23.593186 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822460cb-5c43-4703-8049-24860112589d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:23.593689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822460cb-5c43-4703-8049-24860112589d admin admin] PATH_INFO: `/v3/projects/8b39fcac70a3431f963ad2162d495b8a/users/26df1f0741044871b47cc0cc498e1689/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:23.597944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822460cb-5c43-4703-8049-24860112589d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b39fcac70a3431f963ad2162d495b8a, user_id=26df1f0741044871b47cc0cc498e1689, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:23.602002 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822460cb-5c43-4703-8049-24860112589d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:23.616486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1120/2268] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:23 2022] PUT /identity/v3/projects/8b39fcac70a3431f963ad2162d495b8a/users/26df1f0741044871b47cc0cc498e1689/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:23.737968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06363c-da40-4cbf-be47-7bde8cf37a4f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:23.738413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06363c-da40-4cbf-be47-7bde8cf37a4f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:23.738719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06363c-da40-4cbf-be47-7bde8cf37a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:23.764231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ec06363c-da40-4cbf-be47-7bde8cf37a4f None None] MFA Rules not processed for user `44ffd5660baa40a7a3d6918cb5d31e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:23.765738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ec06363c-da40-4cbf-be47-7bde8cf37a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:23.834100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1149/2269] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:25.755175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822460cb-5c43-4703-8049-24860112589d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:25.757818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-822460cb-5c43-4703-8049-24860112589d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:25.901246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822460cb-5c43-4703-8049-24860112589d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:25.910631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:25.911531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:25.911990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:25.912307 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] PATH_INFO: `/v3/users/a8ae20e4257048b4a5824450564298ad` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:25.913930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ae20e4257048b4a5824450564298ad)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:25.932386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:26.019479 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f892-7407-4703-a798-58ef9ca22c90 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:26.019979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f892-7407-4703-a798-58ef9ca22c90 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:26.020102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f892-7407-4703-a798-58ef9ca22c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:26.070243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c5a0f892-7407-4703-a798-58ef9ca22c90 None None] MFA Rules not processed for user `26df1f0741044871b47cc0cc498e1689`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:26.070243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c5a0f892-7407-4703-a798-58ef9ca22c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:26.200403 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ae20e4257048b4a5824450564298ad'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:26.205437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ae20e4257048b4a5824450564298ad'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:26.233391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1150/2270] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:26.234816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ae20e4257048b4a5824450564298ad'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:26.236185 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ae20e4257048b4a5824450564298ad'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:26.246963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f892-7407-4703-a798-58ef9ca22c90 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:26.252179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c5a0f892-7407-4703-a798-58ef9ca22c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:26.257055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b4cab6bd-4292-4c8b-b24a-22d91aac4871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ae20e4257048b4a5824450564298ad'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:26.337647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f892-7407-4703-a798-58ef9ca22c90 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:26.340885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1121/2271] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:25 2022] DELETE /identity/v3/users/a8ae20e4257048b4a5824450564298ad => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:26.345074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af09f4-a8a5-4b15-83e5-7154408e718a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:26.345787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af09f4-a8a5-4b15-83e5-7154408e718a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:26.346247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af09f4-a8a5-4b15-83e5-7154408e718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:26.374481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-86af09f4-a8a5-4b15-83e5-7154408e718a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:26.375978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-86af09f4-a8a5-4b15-83e5-7154408e718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:26.400196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:26.402069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:26.402609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:26.402891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:26.404836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:26.457824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1122/2272] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:17:26.468360 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af09f4-a8a5-4b15-83e5-7154408e718a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:26.469758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-86af09f4-a8a5-4b15-83e5-7154408e718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:26.474906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:26.476634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:26.486739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1151/2273] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:26.529488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af09f4-a8a5-4b15-83e5-7154408e718a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:26.533768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f6f6c-758c-4b05-8592-4a3cc8cf0ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:26.534539 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6f6c-758c-4b05-8592-4a3cc8cf0ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:26.534829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6f6c-758c-4b05-8592-4a3cc8cf0ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:26.535147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f6f6c-758c-4b05-8592-4a3cc8cf0ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:26.545341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f6f6c-758c-4b05-8592-4a3cc8cf0ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:26.546904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f6f6c-758c-4b05-8592-4a3cc8cf0ba2 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:26.558149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1123/2274] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:17:27.003122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:27.004579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:27.030337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773525c9-5951-4d24-a524-d4663fe6a4f3 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:27.037314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:27.038295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.038688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.039066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] PATH_INFO: `/v3/projects/08b189f79a3a489886e794914b56f9cb` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:27.040506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b189f79a3a489886e794914b56f9cb)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:27.043244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:27.119188 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d274c25-a3e1-4f63-ab66-d5ccfa4ec975 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.119796 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d274c25-a3e1-4f63-ab66-d5ccfa4ec975 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.119914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d274c25-a3e1-4f63-ab66-d5ccfa4ec975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:27.146810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5d274c25-a3e1-4f63-ab66-d5ccfa4ec975 None None] MFA Rules not processed for user `064ef0ac470b458ba5a675364f9cab31`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:27.148728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5d274c25-a3e1-4f63-ab66-d5ccfa4ec975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:27.199237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b189f79a3a489886e794914b56f9cb', 'request_id': 'req-61ba54ab-e2d6-494b-af35-2d35a7a76f54'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:27.241273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1124/2275] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:27.303809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b189f79a3a489886e794914b56f9cb', 'request_id': 'req-61ba54ab-e2d6-494b-af35-2d35a7a76f54'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:27.310901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b189f79a3a489886e794914b56f9cb', 'request_id': 'req-61ba54ab-e2d6-494b-af35-2d35a7a76f54'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:27.328097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] The token cache is being invalidate because project 08b189f79a3a489886e794914b56f9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:27.328392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:27.338218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-61ba54ab-e2d6-494b-af35-2d35a7a76f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:27.341371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1152/2276] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:26 2022] DELETE /identity/v3/projects/08b189f79a3a489886e794914b56f9cb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:27.346556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cfe5e-7e6a-424c-994d-5c3a675b1fde None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.347222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cfe5e-7e6a-424c-994d-5c3a675b1fde None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.347673 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cfe5e-7e6a-424c-994d-5c3a675b1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:27.371240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0f8cfe5e-7e6a-424c-994d-5c3a675b1fde None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:27.375035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0f8cfe5e-7e6a-424c-994d-5c3a675b1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:27.456537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1125/2277] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:27.459062 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeae24-4d53-48df-a0a7-a746435f530b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.459544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeae24-4d53-48df-a0a7-a746435f530b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.459989 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeae24-4d53-48df-a0a7-a746435f530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:27.482984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-2dfeae24-4d53-48df-a0a7-a746435f530b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:27.484803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2dfeae24-4d53-48df-a0a7-a746435f530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:27.493649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1153/2278] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:27.502033 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cfe5e-7e6a-424c-994d-5c3a675b1fde None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:27.518889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cfe5e-7e6a-424c-994d-5c3a675b1fde None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:27.525268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58878477-60d6-4a9f-82bf-b2ef04a1ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:27.526333 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58878477-60d6-4a9f-82bf-b2ef04a1ba87 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.527304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58878477-60d6-4a9f-82bf-b2ef04a1ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.527753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58878477-60d6-4a9f-82bf-b2ef04a1ba87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:27.528529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58878477-60d6-4a9f-82bf-b2ef04a1ba87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:17:27.528841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58878477-60d6-4a9f-82bf-b2ef04a1ba87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:27.531004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58878477-60d6-4a9f-82bf-b2ef04a1ba87 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:27.545868 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1126/2279] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:17:27.550791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeae24-4d53-48df-a0a7-a746435f530b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:27.561696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeae24-4d53-48df-a0a7-a746435f530b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:27.566816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92ddf-58bd-4dd8-90fa-ab5211aec6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:27.567806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92ddf-58bd-4dd8-90fa-ab5211aec6ee admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.568156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92ddf-58bd-4dd8-90fa-ab5211aec6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.568500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92ddf-58bd-4dd8-90fa-ab5211aec6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:27.569222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead92ddf-58bd-4dd8-90fa-ab5211aec6ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:27.571472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead92ddf-58bd-4dd8-90fa-ab5211aec6ee admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:27.691664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1154/2280] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:17:27 2022] POST /identity/v3/projects => generated 399 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:27.693020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58878477-60d6-4a9f-82bf-b2ef04a1ba87 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:27.704467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58878477-60d6-4a9f-82bf-b2ef04a1ba87 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:27.789753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad365c-8c16-4852-adee-f97b0e7f3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:27.790484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad365c-8c16-4852-adee-f97b0e7f3c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.790780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad365c-8c16-4852-adee-f97b0e7f3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.791040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad365c-8c16-4852-adee-f97b0e7f3c0c admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:27.792710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad365c-8c16-4852-adee-f97b0e7f3c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:27.795243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad365c-8c16-4852-adee-f97b0e7f3c0c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:27.885610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1127/2281] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:17:27 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:17:27.887106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92ddf-58bd-4dd8-90fa-ab5211aec6ee admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:27.902963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92ddf-58bd-4dd8-90fa-ab5211aec6ee admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:27.909461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0b3dc-3aaa-436c-98d3-de23a847a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:27.910173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0b3dc-3aaa-436c-98d3-de23a847a8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.910476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0b3dc-3aaa-436c-98d3-de23a847a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.910753 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0b3dc-3aaa-436c-98d3-de23a847a8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:27.911502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0b3dc-3aaa-436c-98d3-de23a847a8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:27.913857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0b3dc-3aaa-436c-98d3-de23a847a8f1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:27.928865 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1155/2282] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:17:27.930111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad365c-8c16-4852-adee-f97b0e7f3c0c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:27.947979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad365c-8c16-4852-adee-f97b0e7f3c0c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:27.952792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b45402-7d72-4b23-a1d6-26daa9dcd964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:27.953458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b45402-7d72-4b23-a1d6-26daa9dcd964 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.953746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b45402-7d72-4b23-a1d6-26daa9dcd964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.954127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b45402-7d72-4b23-a1d6-26daa9dcd964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:27.954866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b45402-7d72-4b23-a1d6-26daa9dcd964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:27.956784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b45402-7d72-4b23-a1d6-26daa9dcd964 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:27.971473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1128/2283] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:17:27.972506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0b3dc-3aaa-436c-98d3-de23a847a8f1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:27.990781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0b3dc-3aaa-436c-98d3-de23a847a8f1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:27.996943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a248838-7974-4e0f-899f-b03549b40eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:27.997931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a248838-7974-4e0f-899f-b03549b40eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:27.998328 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a248838-7974-4e0f-899f-b03549b40eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:27.998677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a248838-7974-4e0f-899f-b03549b40eaf admin admin] PATH_INFO: `/v3/projects/e3918f29d7064c0cb4424b7d62bb47cd/users/a12c2484294f4cc8b8c3fc8078fc456c/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:28.028849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a248838-7974-4e0f-899f-b03549b40eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3918f29d7064c0cb4424b7d62bb47cd, user_id=a12c2484294f4cc8b8c3fc8078fc456c, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:28.032006 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a248838-7974-4e0f-899f-b03549b40eaf admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:28.176996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1156/2284] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:17:27 2022] PUT /identity/v3/projects/e3918f29d7064c0cb4424b7d62bb47cd/users/a12c2484294f4cc8b8c3fc8078fc456c/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:17:28.177732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fe589-ecc9-4614-a8b9-a1d02b70f679 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:28.178840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fe589-ecc9-4614-a8b9-a1d02b70f679 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:28.179433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fe589-ecc9-4614-a8b9-a1d02b70f679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:28.212149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-280fe589-ecc9-4614-a8b9-a1d02b70f679 None None] MFA Rules not processed for user `a12c2484294f4cc8b8c3fc8078fc456c`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:28.223439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-280fe589-ecc9-4614-a8b9-a1d02b70f679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:28.234414 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a248838-7974-4e0f-899f-b03549b40eaf admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:28.236388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2a248838-7974-4e0f-899f-b03549b40eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:28.320647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a248838-7974-4e0f-899f-b03549b40eaf admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:28.325747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec27fb-e9bc-4eb7-ab1b-0989699fb7b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:28.326433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec27fb-e9bc-4eb7-ab1b-0989699fb7b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:28.326714 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec27fb-e9bc-4eb7-ab1b-0989699fb7b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:28.326987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec27fb-e9bc-4eb7-ab1b-0989699fb7b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:28.328891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-deec27fb-e9bc-4eb7-ab1b-0989699fb7b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:28.333648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1129/2285] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:28.442954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec27fb-e9bc-4eb7-ab1b-0989699fb7b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:28.445063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec27fb-e9bc-4eb7-ab1b-0989699fb7b4 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:28.466215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1157/2286] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:17:28.655766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fe589-ecc9-4614-a8b9-a1d02b70f679 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:28.657385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-280fe589-ecc9-4614-a8b9-a1d02b70f679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:28.671467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fe589-ecc9-4614-a8b9-a1d02b70f679 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:28.675594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d40b7-9c37-4d27-a163-6f99f4b82384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:28.676244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d40b7-9c37-4d27-a163-6f99f4b82384 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:28.676528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d40b7-9c37-4d27-a163-6f99f4b82384 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:28.676794 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d40b7-9c37-4d27-a163-6f99f4b82384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:28.686624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d40b7-9c37-4d27-a163-6f99f4b82384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:28.688091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d40b7-9c37-4d27-a163-6f99f4b82384 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:28.704955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1130/2287] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:17:33.229872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefce64-dbf8-41a3-a6b4-bba772f4be72 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:33.229872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefce64-dbf8-41a3-a6b4-bba772f4be72 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:33.229872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefce64-dbf8-41a3-a6b4-bba772f4be72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:33.250203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-eaefce64-dbf8-41a3-a6b4-bba772f4be72 None None] MFA Rules not processed for user `a14795cb97ac44b2a7fc1e2f79b12253`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:33.251490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-eaefce64-dbf8-41a3-a6b4-bba772f4be72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:33.325511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1158/2288] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:35.455206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aaf2e-856e-4271-825c-42c88d589255 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:35.455673 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aaf2e-856e-4271-825c-42c88d589255 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:35.455783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aaf2e-856e-4271-825c-42c88d589255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:35.507129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a99aaf2e-856e-4271-825c-42c88d589255 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:35.508377 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a99aaf2e-856e-4271-825c-42c88d589255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:35.576790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1131/2289] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:35.590674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefce64-dbf8-41a3-a6b4-bba772f4be72 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:35.592888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-eaefce64-dbf8-41a3-a6b4-bba772f4be72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:35.688854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefce64-dbf8-41a3-a6b4-bba772f4be72 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:35.694545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757beb-234f-472a-beb5-924d182cbfe6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:35.695210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757beb-234f-472a-beb5-924d182cbfe6 service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:35.695616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757beb-234f-472a-beb5-924d182cbfe6 service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:35.695819 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9757beb-234f-472a-beb5-924d182cbfe6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:35.704756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757beb-234f-472a-beb5-924d182cbfe6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:35.706495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9757beb-234f-472a-beb5-924d182cbfe6 service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:35.714940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1159/2290] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:17:40.463527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218ffc-62a3-44da-b798-1a9b3bac8885 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:40.464630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218ffc-62a3-44da-b798-1a9b3bac8885 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:40.464776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218ffc-62a3-44da-b798-1a9b3bac8885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:40.485647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bd218ffc-62a3-44da-b798-1a9b3bac8885 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:40.486786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bd218ffc-62a3-44da-b798-1a9b3bac8885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:40.494184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1132/2291] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:17:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:17:40.506906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757beb-234f-472a-beb5-924d182cbfe6 service swift] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:40.518375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9757beb-234f-472a-beb5-924d182cbfe6 service swift] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:40.524001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc258ca-4fa1-4a94-95c4-292c52cf5d29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:40.524674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc258ca-4fa1-4a94-95c4-292c52cf5d29 service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:40.524971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc258ca-4fa1-4a94-95c4-292c52cf5d29 service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:40.530464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc258ca-4fa1-4a94-95c4-292c52cf5d29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:40.535941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc258ca-4fa1-4a94-95c4-292c52cf5d29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:40.537675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc258ca-4fa1-4a94-95c4-292c52cf5d29 service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:40.548009 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1160/2292] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:17:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:17:41.768174 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd218ffc-62a3-44da-b798-1a9b3bac8885 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:41.870602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd218ffc-62a3-44da-b798-1a9b3bac8885 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:41.876936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:41.877884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:41.878295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:41.878701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] PATH_INFO: `/v3/users/a12c2484294f4cc8b8c3fc8078fc456c` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:41.879854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12c2484294f4cc8b8c3fc8078fc456c)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:41.882289 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:42.350262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12c2484294f4cc8b8c3fc8078fc456c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:42.353256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12c2484294f4cc8b8c3fc8078fc456c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:42.415769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12c2484294f4cc8b8c3fc8078fc456c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:42.434388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12c2484294f4cc8b8c3fc8078fc456c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:42.467098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12c2484294f4cc8b8c3fc8078fc456c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:42.593486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1133/2293] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:41 2022] DELETE /identity/v3/users/a12c2484294f4cc8b8c3fc8078fc456c => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:42.598202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf297e-b11a-4a8b-8fae-c62188d5db19 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:42.599130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf297e-b11a-4a8b-8fae-c62188d5db19 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:42.599591 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf297e-b11a-4a8b-8fae-c62188d5db19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:42.649086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-badf297e-b11a-4a8b-8fae-c62188d5db19 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:17:42.652061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-badf297e-b11a-4a8b-8fae-c62188d5db19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:42.774194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1161/2294] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:17:42.782196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:42.785813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:42.915145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0e4d8-096d-4e8b-8b26-25ac4812b5a8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:42.926127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd28f7-9fab-4482-9779-7825fb3dbf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:42.930669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd28f7-9fab-4482-9779-7825fb3dbf03 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:42.931090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd28f7-9fab-4482-9779-7825fb3dbf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:42.931468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd28f7-9fab-4482-9779-7825fb3dbf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:42.944226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd28f7-9fab-4482-9779-7825fb3dbf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:42.946045 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd28f7-9fab-4482-9779-7825fb3dbf03 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:42.958418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1134/2295] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:17:44.153061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf297e-b11a-4a8b-8fae-c62188d5db19 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:44.153918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-badf297e-b11a-4a8b-8fae-c62188d5db19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:44.190875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf297e-b11a-4a8b-8fae-c62188d5db19 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:44.232561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:44.233649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:44.233935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:44.234391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] PATH_INFO: `/v3/projects/e3918f29d7064c0cb4424b7d62bb47cd` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:44.238991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3918f29d7064c0cb4424b7d62bb47cd)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:44.302295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:17:44.448100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3918f29d7064c0cb4424b7d62bb47cd', 'request_id': 'req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:44.617766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3918f29d7064c0cb4424b7d62bb47cd', 'request_id': 'req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:44.625996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3918f29d7064c0cb4424b7d62bb47cd', 'request_id': 'req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:44.638253 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] The token cache is being invalidate because project e3918f29d7064c0cb4424b7d62bb47cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:17:44.638650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:44.639492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:17:44.641485 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1162/2296] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:17:44 2022] DELETE /identity/v3/projects/e3918f29d7064c0cb4424b7d62bb47cd => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:17:59.730129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd28f7-9fab-4482-9779-7825fb3dbf03 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:17:59.732256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f4bd28f7-9fab-4482-9779-7825fb3dbf03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:17:59.791529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd28f7-9fab-4482-9779-7825fb3dbf03 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:17:59.904827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:17:59.906142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:17:59.906633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:17:59.907240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] PATH_INFO: `/v3/users/ded09237c4dd42d6aac26c7710c0a7b4` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:17:59.909442 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded09237c4dd42d6aac26c7710c0a7b4)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:17:59.912168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:00.185428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded09237c4dd42d6aac26c7710c0a7b4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.187612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded09237c4dd42d6aac26c7710c0a7b4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.209540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded09237c4dd42d6aac26c7710c0a7b4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.210512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded09237c4dd42d6aac26c7710c0a7b4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.222818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32d409b3-ce94-4314-aadd-2c4f1f9c3275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded09237c4dd42d6aac26c7710c0a7b4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.259851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:00.266090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:00.279032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a5c7d-157e-4561-bebf-d5a1e3d13bd3 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:00.285627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:00.287266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:00.287724 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:00.288157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] PATH_INFO: `/v3/users/74c67d9ab7da4cf186f3dbae63f2c4cf` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:00.289603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c67d9ab7da4cf186f3dbae63f2c4cf)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:00.291888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:00.321861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1135/2297] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:17:59 2022] DELETE /identity/v3/users/ded09237c4dd42d6aac26c7710c0a7b4 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:00.326371 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2956869-e66f-4be1-a2b5-3c9c03005590 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:00.326659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2956869-e66f-4be1-a2b5-3c9c03005590 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:00.326943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2956869-e66f-4be1-a2b5-3c9c03005590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:00.401271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d2956869-e66f-4be1-a2b5-3c9c03005590 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:00.402573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d2956869-e66f-4be1-a2b5-3c9c03005590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:00.492498 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c67d9ab7da4cf186f3dbae63f2c4cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.493809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c67d9ab7da4cf186f3dbae63f2c4cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.494621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c67d9ab7da4cf186f3dbae63f2c4cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.532457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c67d9ab7da4cf186f3dbae63f2c4cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.548178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c67d9ab7da4cf186f3dbae63f2c4cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:00.550447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1136/2298] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:18:00.575429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2956869-e66f-4be1-a2b5-3c9c03005590 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:00.577212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d2956869-e66f-4be1-a2b5-3c9c03005590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:00.653670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2956869-e66f-4be1-a2b5-3c9c03005590 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:00.658077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bcd2d-71b2-47ce-bd8d-2aa3a19f6543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:00.658744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bcd2d-71b2-47ce-bd8d-2aa3a19f6543 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:00.659027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bcd2d-71b2-47ce-bd8d-2aa3a19f6543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:00.659304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7bcd2d-71b2-47ce-bd8d-2aa3a19f6543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:00.660213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1163/2299] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:18:00 2022] DELETE /identity/v3/users/74c67d9ab7da4cf186f3dbae63f2c4cf => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:18:00.673970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bcd2d-71b2-47ce-bd8d-2aa3a19f6543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:00.675461 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7bcd2d-71b2-47ce-bd8d-2aa3a19f6543 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:00.698390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1137/2300] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:18:01.050809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:01.050809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:01.149465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8902a6-3864-48ed-847f-ff2491a05d93 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:01.155699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:01.156635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:01.156918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:01.157192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] PATH_INFO: `/v3/projects/851018b96f7547b6be0bfbbbeb7d48a2` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:01.158679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851018b96f7547b6be0bfbbbeb7d48a2)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:01.161169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:01.317561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851018b96f7547b6be0bfbbbeb7d48a2', 'request_id': 'req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.369329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bcd2d-71b2-47ce-bd8d-2aa3a19f6543 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:01.371149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2e7bcd2d-71b2-47ce-bd8d-2aa3a19f6543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:01.389689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851018b96f7547b6be0bfbbbeb7d48a2', 'request_id': 'req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.397845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7bcd2d-71b2-47ce-bd8d-2aa3a19f6543 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:01.398962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851018b96f7547b6be0bfbbbeb7d48a2', 'request_id': 'req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.470793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] The token cache is being invalidate because project 851018b96f7547b6be0bfbbbeb7d48a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:18:01.471698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.475826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.477429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:01.479029 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:01.479322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:01.479597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] PATH_INFO: `/v3/projects/7b8078c2370a471692860aaf4320c3f6` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:01.480572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1164/2301] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:18:01 2022] DELETE /identity/v3/projects/851018b96f7547b6be0bfbbbeb7d48a2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:01.484582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8078c2370a471692860aaf4320c3f6)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:01.486578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:01.496891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:01.503284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:01.532624 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8b92d-d85e-4b5e-b54b-8b3ea62945d2 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:01.556672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:01.557503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:01.557998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:01.558560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] PATH_INFO: `/v3/users/26df1f0741044871b47cc0cc498e1689` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:01.560188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26df1f0741044871b47cc0cc498e1689)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:01.562514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:01.680331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8078c2370a471692860aaf4320c3f6', 'request_id': 'req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.709404 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8078c2370a471692860aaf4320c3f6', 'request_id': 'req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.730397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8078c2370a471692860aaf4320c3f6', 'request_id': 'req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.777281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26df1f0741044871b47cc0cc498e1689'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.778540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26df1f0741044871b47cc0cc498e1689'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.779496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26df1f0741044871b47cc0cc498e1689'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.796693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26df1f0741044871b47cc0cc498e1689'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.804967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c26808ee-f3ba-4f53-add7-b3cfd8c4794a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26df1f0741044871b47cc0cc498e1689'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.840247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] The token cache is being invalidate because project 7b8078c2370a471692860aaf4320c3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:18:01.840583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.844944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d6f6c79-0d21-4f03-89f4-3cff42b34c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:01.847036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1138/2302] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:18:01 2022] DELETE /identity/v3/projects/7b8078c2370a471692860aaf4320c3f6 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:18:01.851669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0660481-89bb-48f8-8574-61795664c048 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:01.851953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0660481-89bb-48f8-8574-61795664c048 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:01.852227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0660481-89bb-48f8-8574-61795664c048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:01.884715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e0660481-89bb-48f8-8574-61795664c048 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:01.886290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e0660481-89bb-48f8-8574-61795664c048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:01.920210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1165/2303] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:18:01 2022] DELETE /identity/v3/users/26df1f0741044871b47cc0cc498e1689 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:02.006519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff78d1-4f26-44a4-91a2-34018c76af92 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.006786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff78d1-4f26-44a4-91a2-34018c76af92 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.007131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff78d1-4f26-44a4-91a2-34018c76af92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.010823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1139/2304] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:02.029214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-69ff78d1-4f26-44a4-91a2-34018c76af92 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:02.030954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-69ff78d1-4f26-44a4-91a2-34018c76af92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:02.127697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1166/2305] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:02.131966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0660481-89bb-48f8-8574-61795664c048 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:02.162511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0660481-89bb-48f8-8574-61795664c048 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:02.176221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b5ae-c89f-4168-b835-5dd4254a0bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:02.176221 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b5ae-c89f-4168-b835-5dd4254a0bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.176551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b5ae-c89f-4168-b835-5dd4254a0bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.176813 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b5ae-c89f-4168-b835-5dd4254a0bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.178763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b5ae-c89f-4168-b835-5dd4254a0bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:18:02.178763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b5ae-c89f-4168-b835-5dd4254a0bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:02.180509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b5ae-c89f-4168-b835-5dd4254a0bd3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:02.209717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1140/2306] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:18:02.210355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff78d1-4f26-44a4-91a2-34018c76af92 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:02.226782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff78d1-4f26-44a4-91a2-34018c76af92 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:02.235574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303b52b-984a-4d32-bd6b-6fc890d81ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:02.236261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303b52b-984a-4d32-bd6b-6fc890d81ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.236543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303b52b-984a-4d32-bd6b-6fc890d81ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.236817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303b52b-984a-4d32-bd6b-6fc890d81ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.237525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303b52b-984a-4d32-bd6b-6fc890d81ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:02.239550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303b52b-984a-4d32-bd6b-6fc890d81ba9 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:02.345340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1167/2307] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:18:02 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:02.349319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b5ae-c89f-4168-b835-5dd4254a0bd3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:02.361280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b5ae-c89f-4168-b835-5dd4254a0bd3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:02.500684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93d3cd-1c01-446f-a6a3-6e61058030f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:02.501436 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93d3cd-1c01-446f-a6a3-6e61058030f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.501641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93d3cd-1c01-446f-a6a3-6e61058030f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.501910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93d3cd-1c01-446f-a6a3-6e61058030f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.502646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93d3cd-1c01-446f-a6a3-6e61058030f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:02.504710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93d3cd-1c01-446f-a6a3-6e61058030f9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:02.533823 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303b52b-984a-4d32-bd6b-6fc890d81ba9 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:02.536294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3303b52b-984a-4d32-bd6b-6fc890d81ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:02.553748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303b52b-984a-4d32-bd6b-6fc890d81ba9 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:02.560784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:02.561760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.562188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.562604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] PATH_INFO: `/v3/projects/8b39fcac70a3431f963ad2162d495b8a` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.564237 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b39fcac70a3431f963ad2162d495b8a)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:02.566859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:02.608261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1141/2308] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:18:02 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:02.612737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93d3cd-1c01-446f-a6a3-6e61058030f9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:02.626838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93d3cd-1c01-446f-a6a3-6e61058030f9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:02.632750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82f12-d065-46c0-a903-5e6af2b53dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:02.633444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82f12-d065-46c0-a903-5e6af2b53dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.633930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82f12-d065-46c0-a903-5e6af2b53dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.634515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82f12-d065-46c0-a903-5e6af2b53dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.636000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c82f12-d065-46c0-a903-5e6af2b53dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:02.642689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c82f12-d065-46c0-a903-5e6af2b53dfb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:02.678818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1142/2309] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:18:02.690374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b39fcac70a3431f963ad2162d495b8a', 'request_id': 'req-8725ed21-27c1-4614-8a0f-2e6486b856d5'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:02.691031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82f12-d065-46c0-a903-5e6af2b53dfb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:02.704423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82f12-d065-46c0-a903-5e6af2b53dfb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:02.736962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b39fcac70a3431f963ad2162d495b8a', 'request_id': 'req-8725ed21-27c1-4614-8a0f-2e6486b856d5'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:02.746369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b39fcac70a3431f963ad2162d495b8a', 'request_id': 'req-8725ed21-27c1-4614-8a0f-2e6486b856d5'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:02.773417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] The token cache is being invalidate because project 8b39fcac70a3431f963ad2162d495b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:18:02.775078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:02.776680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8725ed21-27c1-4614-8a0f-2e6486b856d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:02.782960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1168/2310] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:18:02 2022] DELETE /identity/v3/projects/8b39fcac70a3431f963ad2162d495b8a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:02.787675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d73ca-162c-4d9b-9132-71241de859c8 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.788019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d73ca-162c-4d9b-9132-71241de859c8 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.788445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d73ca-162c-4d9b-9132-71241de859c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.840026 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-6d7d73ca-162c-4d9b-9132-71241de859c8 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:02.842120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6d7d73ca-162c-4d9b-9132-71241de859c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:02.854727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1c460-cbd4-4303-8e1a-32d0a5400d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:02.860536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1c460-cbd4-4303-8e1a-32d0a5400d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.862255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1c460-cbd4-4303-8e1a-32d0a5400d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.862255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1c460-cbd4-4303-8e1a-32d0a5400d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.862255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1c460-cbd4-4303-8e1a-32d0a5400d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:02.872080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1c460-cbd4-4303-8e1a-32d0a5400d2c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:02.875093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1169/2311] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:18:02.885829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe17c2c-3a65-4c5d-8d20-6084be6a805a None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.886354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe17c2c-3a65-4c5d-8d20-6084be6a805a None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.886806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe17c2c-3a65-4c5d-8d20-6084be6a805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.908493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1143/2312] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:18:02.908763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-4fe17c2c-3a65-4c5d-8d20-6084be6a805a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:02.910427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4fe17c2c-3a65-4c5d-8d20-6084be6a805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:02.913769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1c460-cbd4-4303-8e1a-32d0a5400d2c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:02.921186 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f5d1c460-cbd4-4303-8e1a-32d0a5400d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:02.924268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1170/2313] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:02.928007 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe17c2c-3a65-4c5d-8d20-6084be6a805a None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:02.949715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe17c2c-3a65-4c5d-8d20-6084be6a805a None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:02.958712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c1bf3-becf-49fd-8e05-36aca3127483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:02.959438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c1bf3-becf-49fd-8e05-36aca3127483 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.959770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c1bf3-becf-49fd-8e05-36aca3127483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.960047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c1bf3-becf-49fd-8e05-36aca3127483 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:02.960787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c1bf3-becf-49fd-8e05-36aca3127483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:18:02.961094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c1bf3-becf-49fd-8e05-36aca3127483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:02.962982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c1bf3-becf-49fd-8e05-36aca3127483 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:02.967027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1c460-cbd4-4303-8e1a-32d0a5400d2c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:02.983606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1171/2314] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:18:02.984871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c1bf3-becf-49fd-8e05-36aca3127483 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:02.990105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb4440-650b-459a-8554-23637ea045d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:02.991183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb4440-650b-459a-8554-23637ea045d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:02.991474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb4440-650b-459a-8554-23637ea045d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:02.991809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb4440-650b-459a-8554-23637ea045d0 admin admin] PATH_INFO: `/v3/projects/b025f7f102ee46fa92e9bb7445e59daa/users/b34f24054c204d7cb69ca41099913ca5/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:03.031427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c1bf3-becf-49fd-8e05-36aca3127483 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:03.046122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7514f2-5eff-429b-b691-22e70621d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:03.046802 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7514f2-5eff-429b-b691-22e70621d7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:03.058416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb4440-650b-459a-8554-23637ea045d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b025f7f102ee46fa92e9bb7445e59daa, user_id=b34f24054c204d7cb69ca41099913ca5, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:03.061886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb4440-650b-459a-8554-23637ea045d0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:03.069427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7514f2-5eff-429b-b691-22e70621d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:03.070003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7514f2-5eff-429b-b691-22e70621d7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:03.071103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7514f2-5eff-429b-b691-22e70621d7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:03.076586 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7514f2-5eff-429b-b691-22e70621d7f1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:03.213254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1144/2315] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:18:02 2022] PUT /identity/v3/projects/b025f7f102ee46fa92e9bb7445e59daa/users/b34f24054c204d7cb69ca41099913ca5/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:03.213850 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381030-b78a-42ea-be38-51ebd9204530 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:03.214306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381030-b78a-42ea-be38-51ebd9204530 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:03.214705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381030-b78a-42ea-be38-51ebd9204530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:03.236613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9f381030-b78a-42ea-be38-51ebd9204530 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:03.239106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9f381030-b78a-42ea-be38-51ebd9204530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:03.244474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1172/2316] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:18:02 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:03.250885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7514f2-5eff-429b-b691-22e70621d7f1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:03.360686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7514f2-5eff-429b-b691-22e70621d7f1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:03.377797 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f0d10-c981-44f8-b7d3-7e06e4dd8b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:03.381095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f0d10-c981-44f8-b7d3-7e06e4dd8b6f admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:03.382123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f0d10-c981-44f8-b7d3-7e06e4dd8b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:03.383295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f0d10-c981-44f8-b7d3-7e06e4dd8b6f admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:03.385658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f0d10-c981-44f8-b7d3-7e06e4dd8b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:03.387312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1145/2317] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:03.389555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f0d10-c981-44f8-b7d3-7e06e4dd8b6f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:03.397073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f381030-b78a-42ea-be38-51ebd9204530 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:03.399384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9f381030-b78a-42ea-be38-51ebd9204530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:03.470105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f381030-b78a-42ea-be38-51ebd9204530 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:03.475725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c886-4296-4a51-8346-9a9f0dff8c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:03.476373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c886-4296-4a51-8346-9a9f0dff8c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:03.476650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c886-4296-4a51-8346-9a9f0dff8c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:03.476928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67c886-4296-4a51-8346-9a9f0dff8c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:03.490434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67c886-4296-4a51-8346-9a9f0dff8c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:03.492348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67c886-4296-4a51-8346-9a9f0dff8c7b service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:03.510596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1146/2318] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:18:03.547177 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1173/2319] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:18:03 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:03.548893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c886-4296-4a51-8346-9a9f0dff8c7b service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:03.560770 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67c886-4296-4a51-8346-9a9f0dff8c7b service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:03.570370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7817-0cfc-4c94-b40f-4ac2a2142f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:03.571060 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7817-0cfc-4c94-b40f-4ac2a2142f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:03.571360 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7817-0cfc-4c94-b40f-4ac2a2142f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:03.571749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7817-0cfc-4c94-b40f-4ac2a2142f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:03.572603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d7817-0cfc-4c94-b40f-4ac2a2142f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:03.574290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d7817-0cfc-4c94-b40f-4ac2a2142f6f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:03.610207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1147/2320] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:18:03.611305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f0d10-c981-44f8-b7d3-7e06e4dd8b6f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:03.624038 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f0d10-c981-44f8-b7d3-7e06e4dd8b6f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:03.641483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66324480-5759-4f83-9e93-6456e56897c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:03.641996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66324480-5759-4f83-9e93-6456e56897c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:03.642319 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66324480-5759-4f83-9e93-6456e56897c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:03.642794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66324480-5759-4f83-9e93-6456e56897c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:03.643565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66324480-5759-4f83-9e93-6456e56897c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:03.645205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66324480-5759-4f83-9e93-6456e56897c7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:03.659790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1174/2321] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:18:03.660787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7817-0cfc-4c94-b40f-4ac2a2142f6f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:03.672766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7817-0cfc-4c94-b40f-4ac2a2142f6f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:03.678177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755fdd4-b849-4952-ad20-f911e5aaa3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:03.679246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755fdd4-b849-4952-ad20-f911e5aaa3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:03.679385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755fdd4-b849-4952-ad20-f911e5aaa3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:03.679619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755fdd4-b849-4952-ad20-f911e5aaa3ea admin admin] PATH_INFO: `/v3/projects/761f4aefe19c40e385235f8930c70937/users/55fd7588cb5d45a3becfdc75f7b35497/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:03.710682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755fdd4-b849-4952-ad20-f911e5aaa3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=761f4aefe19c40e385235f8930c70937, user_id=55fd7588cb5d45a3becfdc75f7b35497, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:03.714305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755fdd4-b849-4952-ad20-f911e5aaa3ea admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:03.807946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1148/2322] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:18:03 2022] PUT /identity/v3/projects/761f4aefe19c40e385235f8930c70937/users/55fd7588cb5d45a3becfdc75f7b35497/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:03.818660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded644ba-65a9-46cc-8ec0-363ac7021878 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:03.819023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded644ba-65a9-46cc-8ec0-363ac7021878 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:03.819377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded644ba-65a9-46cc-8ec0-363ac7021878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:03.872152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ded644ba-65a9-46cc-8ec0-363ac7021878 None None] MFA Rules not processed for user `55fd7588cb5d45a3becfdc75f7b35497`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:03.873588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ded644ba-65a9-46cc-8ec0-363ac7021878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:04.002115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1175/2323] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:04.005177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755fdd4-b849-4952-ad20-f911e5aaa3ea admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:04.084717 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755fdd4-b849-4952-ad20-f911e5aaa3ea admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:04.090098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68c2c3-e6a0-4a07-a6b0-e537091a3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:04.093861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68c2c3-e6a0-4a07-a6b0-e537091a3da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:04.093861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68c2c3-e6a0-4a07-a6b0-e537091a3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:04.093861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68c2c3-e6a0-4a07-a6b0-e537091a3da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:04.093861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68c2c3-e6a0-4a07-a6b0-e537091a3da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:04.093861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68c2c3-e6a0-4a07-a6b0-e537091a3da1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:04.225050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1149/2324] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:18:04 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:04.230652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded644ba-65a9-46cc-8ec0-363ac7021878 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:04.244670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded644ba-65a9-46cc-8ec0-363ac7021878 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:04.361276 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893b66a-b772-4e83-a120-7bff6aecd906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:04.362209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893b66a-b772-4e83-a120-7bff6aecd906 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:04.362303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893b66a-b772-4e83-a120-7bff6aecd906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:04.363106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893b66a-b772-4e83-a120-7bff6aecd906 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:04.363348 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893b66a-b772-4e83-a120-7bff6aecd906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:04.365257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893b66a-b772-4e83-a120-7bff6aecd906 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:04.490216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1176/2325] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:18:04 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:04.495150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68c2c3-e6a0-4a07-a6b0-e537091a3da1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:04.504978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68c2c3-e6a0-4a07-a6b0-e537091a3da1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:04.509987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36da45b-a3e5-4eec-82d8-9d2ec71b7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:04.510750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36da45b-a3e5-4eec-82d8-9d2ec71b7bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:04.511328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36da45b-a3e5-4eec-82d8-9d2ec71b7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:04.511328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36da45b-a3e5-4eec-82d8-9d2ec71b7bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:04.512039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36da45b-a3e5-4eec-82d8-9d2ec71b7bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:04.513702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36da45b-a3e5-4eec-82d8-9d2ec71b7bc3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:04.524325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1150/2326] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:18:04.528327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893b66a-b772-4e83-a120-7bff6aecd906 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:04.538424 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893b66a-b772-4e83-a120-7bff6aecd906 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:04.544809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f73a7c-7356-4a56-9af7-02a7df3dd549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:04.545538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f73a7c-7356-4a56-9af7-02a7df3dd549 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:04.547243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f73a7c-7356-4a56-9af7-02a7df3dd549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:04.547243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f73a7c-7356-4a56-9af7-02a7df3dd549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:04.547243 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f73a7c-7356-4a56-9af7-02a7df3dd549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:04.548533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f73a7c-7356-4a56-9af7-02a7df3dd549 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:04.562602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1177/2327] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:18:04.563853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36da45b-a3e5-4eec-82d8-9d2ec71b7bc3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:04.575250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36da45b-a3e5-4eec-82d8-9d2ec71b7bc3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:04.580324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572ed8-97e7-43a8-803a-f0a5ff59faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:04.581296 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572ed8-97e7-43a8-803a-f0a5ff59faf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:04.581847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572ed8-97e7-43a8-803a-f0a5ff59faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:04.582157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab572ed8-97e7-43a8-803a-f0a5ff59faf5 admin admin] PATH_INFO: `/v3/projects/3810f30331bb4dc09584190d6a5660a3/users/5a1b0c7864e24756995ddd5cffe268de/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:04.598046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572ed8-97e7-43a8-803a-f0a5ff59faf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3810f30331bb4dc09584190d6a5660a3, user_id=5a1b0c7864e24756995ddd5cffe268de, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:04.601636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab572ed8-97e7-43a8-803a-f0a5ff59faf5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:04.674273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1151/2328] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:18:04 2022] PUT /identity/v3/projects/3810f30331bb4dc09584190d6a5660a3/users/5a1b0c7864e24756995ddd5cffe268de/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:04.684825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b896-4580-4073-ac54-299aa5b5c3e3 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:04.685145 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b896-4580-4073-ac54-299aa5b5c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:04.685369 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b896-4580-4073-ac54-299aa5b5c3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:04.717645 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7106b896-4580-4073-ac54-299aa5b5c3e3 None None] MFA Rules not processed for user `5a1b0c7864e24756995ddd5cffe268de`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:04.719390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7106b896-4580-4073-ac54-299aa5b5c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:04.789503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1178/2329] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:04.794729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572ed8-97e7-43a8-803a-f0a5ff59faf5 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:04.859201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab572ed8-97e7-43a8-803a-f0a5ff59faf5 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:04.864289 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313406a-466c-4bf5-b7b6-8b0b6cd80788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:04.864958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313406a-466c-4bf5-b7b6-8b0b6cd80788 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:04.865231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313406a-466c-4bf5-b7b6-8b0b6cd80788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:04.865498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313406a-466c-4bf5-b7b6-8b0b6cd80788 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:04.866214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313406a-466c-4bf5-b7b6-8b0b6cd80788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:04.868152 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313406a-466c-4bf5-b7b6-8b0b6cd80788 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:04.957154 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1152/2330] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:18:04 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:04.958939 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106b896-4580-4073-ac54-299aa5b5c3e3 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:04.970882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106b896-4580-4073-ac54-299aa5b5c3e3 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:05.072453 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f91f65-2b2d-4eee-a579-8abaf3127d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:05.073209 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f91f65-2b2d-4eee-a579-8abaf3127d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:05.073490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f91f65-2b2d-4eee-a579-8abaf3127d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:05.073904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f91f65-2b2d-4eee-a579-8abaf3127d79 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:05.079207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f91f65-2b2d-4eee-a579-8abaf3127d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:05.083115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f91f65-2b2d-4eee-a579-8abaf3127d79 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:05.122659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432dd6c-dbc2-4fc3-9be8-8d2863df3842 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:05.123358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432dd6c-dbc2-4fc3-9be8-8d2863df3842 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:05.124084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432dd6c-dbc2-4fc3-9be8-8d2863df3842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:05.148212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7432dd6c-dbc2-4fc3-9be8-8d2863df3842 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:05.150371 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7432dd6c-dbc2-4fc3-9be8-8d2863df3842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:05.167488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1179/2331] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:18:04 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:05.172523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f91f65-2b2d-4eee-a579-8abaf3127d79 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:05.193483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f91f65-2b2d-4eee-a579-8abaf3127d79 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:05.200626 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a325f7-7399-42bb-a878-f8fb0825c651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:05.201332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a325f7-7399-42bb-a878-f8fb0825c651 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:05.201725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a325f7-7399-42bb-a878-f8fb0825c651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:05.202022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a325f7-7399-42bb-a878-f8fb0825c651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:05.202924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a325f7-7399-42bb-a878-f8fb0825c651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:05.204848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a325f7-7399-42bb-a878-f8fb0825c651 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:05.218335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1180/2332] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:18:05.222159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a325f7-7399-42bb-a878-f8fb0825c651 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:05.227681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1153/2333] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 16 15:18:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:18:05.233614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a325f7-7399-42bb-a878-f8fb0825c651 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:05.241090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efd98e-f74c-490a-aa1c-715cd3efd2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:05.242149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efd98e-f74c-490a-aa1c-715cd3efd2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:05.242434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efd98e-f74c-490a-aa1c-715cd3efd2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:05.242706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efd98e-f74c-490a-aa1c-715cd3efd2b7 admin admin] PATH_INFO: `/v3/projects/100be48c6d5643efb8f6c623e4d4384d/users/8f590808dfb6457593203a02f534bf72/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:05.242821 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432dd6c-dbc2-4fc3-9be8-8d2863df3842 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:05.244335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7432dd6c-dbc2-4fc3-9be8-8d2863df3842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:05.270012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efd98e-f74c-490a-aa1c-715cd3efd2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100be48c6d5643efb8f6c623e4d4384d, user_id=8f590808dfb6457593203a02f534bf72, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:05.273535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efd98e-f74c-490a-aa1c-715cd3efd2b7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:05.325546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432dd6c-dbc2-4fc3-9be8-8d2863df3842 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:05.331034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7675ee-7910-473c-9da9-e7c119d0ae5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:05.331685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7675ee-7910-473c-9da9-e7c119d0ae5a service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:05.331964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7675ee-7910-473c-9da9-e7c119d0ae5a service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:05.332241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7675ee-7910-473c-9da9-e7c119d0ae5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:05.344499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7675ee-7910-473c-9da9-e7c119d0ae5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:05.346263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7675ee-7910-473c-9da9-e7c119d0ae5a service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:05.356759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1154/2334] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:18:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 15:18:05.360857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1181/2335] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:18:05 2022] PUT /identity/v3/projects/100be48c6d5643efb8f6c623e4d4384d/users/8f590808dfb6457593203a02f534bf72/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:18:05.363072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7675ee-7910-473c-9da9-e7c119d0ae5a service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:05.374912 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7675ee-7910-473c-9da9-e7c119d0ae5a service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:05.438028 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbd7e4-3fd5-45b2-8528-a76344532c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:05.438755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbd7e4-3fd5-45b2-8528-a76344532c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:05.439040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbd7e4-3fd5-45b2-8528-a76344532c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:05.439364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbd7e4-3fd5-45b2-8528-a76344532c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:05.440072 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbd7e4-3fd5-45b2-8528-a76344532c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:05.441949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbd7e4-3fd5-45b2-8528-a76344532c42 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:05.458833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1155/2336] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:18:05.459011 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efd98e-f74c-490a-aa1c-715cd3efd2b7 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:05.467310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efd98e-f74c-490a-aa1c-715cd3efd2b7 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:05.472149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c75ea7-51ac-4176-97a7-c44bb55e6bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:05.473023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c75ea7-51ac-4176-97a7-c44bb55e6bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:05.473306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c75ea7-51ac-4176-97a7-c44bb55e6bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:05.473578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c75ea7-51ac-4176-97a7-c44bb55e6bd9 admin admin] PATH_INFO: `/v3/projects/100be48c6d5643efb8f6c623e4d4384d/users/8f590808dfb6457593203a02f534bf72/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:05.475762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c75ea7-51ac-4176-97a7-c44bb55e6bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100be48c6d5643efb8f6c623e4d4384d, user_id=8f590808dfb6457593203a02f534bf72, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:05.479217 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c75ea7-51ac-4176-97a7-c44bb55e6bd9 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:05.489848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1182/2337] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:18:05 2022] PUT /identity/v3/projects/100be48c6d5643efb8f6c623e4d4384d/users/8f590808dfb6457593203a02f534bf72/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:05.571300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1621-12c6-4988-8e94-9edcc8657ecc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:05.572203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1621-12c6-4988-8e94-9edcc8657ecc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:05.572844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b1621-12c6-4988-8e94-9edcc8657ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:05.642297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ec7b1621-12c6-4988-8e94-9edcc8657ecc None None] MFA Rules not processed for user `8f590808dfb6457593203a02f534bf72`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:05.646231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ec7b1621-12c6-4988-8e94-9edcc8657ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:05.739877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1156/2338] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:05.760699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c75ea7-51ac-4176-97a7-c44bb55e6bd9 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:05.762878 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-26c75ea7-51ac-4176-97a7-c44bb55e6bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:05.826433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c75ea7-51ac-4176-97a7-c44bb55e6bd9 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:05.832330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c788-8b77-4501-bc8e-7514a41fa501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:05.833187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c788-8b77-4501-bc8e-7514a41fa501 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:05.833622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c788-8b77-4501-bc8e-7514a41fa501 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:05.834114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c788-8b77-4501-bc8e-7514a41fa501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:05.907460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94c788-8b77-4501-bc8e-7514a41fa501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:05.913072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94c788-8b77-4501-bc8e-7514a41fa501 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:05.920169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1183/2339] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:18:08.356285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b1621-12c6-4988-8e94-9edcc8657ecc None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:08.376931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b1621-12c6-4988-8e94-9edcc8657ecc None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:08.382298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acc0f3-0a8b-462d-b9ea-eae3892722fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:08.386910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acc0f3-0a8b-462d-b9ea-eae3892722fc service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:08.386910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acc0f3-0a8b-462d-b9ea-eae3892722fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:08.386910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acc0f3-0a8b-462d-b9ea-eae3892722fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:08.476649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acc0f3-0a8b-462d-b9ea-eae3892722fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:08.479916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acc0f3-0a8b-462d-b9ea-eae3892722fc service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:08.506096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1157/2340] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:18:08.978347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c788-8b77-4501-bc8e-7514a41fa501 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:08.979935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ca94c788-8b77-4501-bc8e-7514a41fa501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:09.110436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c788-8b77-4501-bc8e-7514a41fa501 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:09.114942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:09.115975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:09.116606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:09.117095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] PATH_INFO: `/v3/users/665ea1968aff4e949cdf07c210e78067` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:09.119409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=665ea1968aff4e949cdf07c210e78067)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:09.121876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:09.427401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665ea1968aff4e949cdf07c210e78067'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:09.430305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665ea1968aff4e949cdf07c210e78067'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:09.433251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665ea1968aff4e949cdf07c210e78067'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:09.472701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665ea1968aff4e949cdf07c210e78067'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:09.482488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665ea1968aff4e949cdf07c210e78067'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:09.654171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1184/2341] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:18:08 2022] DELETE /identity/v3/users/665ea1968aff4e949cdf07c210e78067 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:10.209531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea58c3-bab3-40d3-8cf9-b40e05037d14 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:10.209531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea58c3-bab3-40d3-8cf9-b40e05037d14 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:10.209531 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea58c3-bab3-40d3-8cf9-b40e05037d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:10.223907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:10.226207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:10.288789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e0ea58c3-bab3-40d3-8cf9-b40e05037d14 None None] MFA Rules not processed for user `b34f24054c204d7cb69ca41099913ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:10.293425 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e0ea58c3-bab3-40d3-8cf9-b40e05037d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:10.381648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e34a1e-f471-4a1e-83b0-d57a9b0197ef admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:10.391202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:10.392253 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:10.392610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:10.395216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] PATH_INFO: `/v3/projects/7c186c3409f94fa5bb7452eee4021eea` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:10.396598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c186c3409f94fa5bb7452eee4021eea)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:10.399107 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:10.411730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1158/2342] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:10.412688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea58c3-bab3-40d3-8cf9-b40e05037d14 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:10.415520 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e0ea58c3-bab3-40d3-8cf9-b40e05037d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:10.489097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea58c3-bab3-40d3-8cf9-b40e05037d14 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:10.493432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:10.494226 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:10.494511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:10.494788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:10.496618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:10.521315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c186c3409f94fa5bb7452eee4021eea', 'request_id': 'req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:10.582008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:10.583649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:10.594107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1159/2343] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:18:10.594976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:10.596370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:10.598439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c186c3409f94fa5bb7452eee4021eea', 'request_id': 'req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:10.607923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c186c3409f94fa5bb7452eee4021eea', 'request_id': 'req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:10.613117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2541d0-ba0d-4560-83a6-6ab5df816d64 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:10.622814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] The token cache is being invalidate because project 7c186c3409f94fa5bb7452eee4021eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:18:10.623334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:10.623971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-848a29c1-2b9d-411e-a3b8-88c3c87f08c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:10.626213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1185/2344] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:18:10 2022] DELETE /identity/v3/projects/7c186c3409f94fa5bb7452eee4021eea => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:18:10.631990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb45a72-d9d2-47cc-9027-5adf0a66d5a4 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:10.632411 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb45a72-d9d2-47cc-9027-5adf0a66d5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:10.632781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb45a72-d9d2-47cc-9027-5adf0a66d5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:10.663095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8cb45a72-d9d2-47cc-9027-5adf0a66d5a4 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:10.665018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8cb45a72-d9d2-47cc-9027-5adf0a66d5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:10.697458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e003e4-2d43-46da-a59f-ff655d9e8382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:10.698267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e003e4-2d43-46da-a59f-ff655d9e8382 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:10.698557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e003e4-2d43-46da-a59f-ff655d9e8382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:10.702998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e003e4-2d43-46da-a59f-ff655d9e8382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:10.702998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e003e4-2d43-46da-a59f-ff655d9e8382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:10.702998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e003e4-2d43-46da-a59f-ff655d9e8382 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:10.750473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1186/2345] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:10.760905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8589a-83ab-4329-8834-cb156076e4fa None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:10.761217 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8589a-83ab-4329-8834-cb156076e4fa None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:10.762148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8589a-83ab-4329-8834-cb156076e4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:10.796361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d7d8589a-83ab-4329-8834-cb156076e4fa None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:10.796361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d7d8589a-83ab-4329-8834-cb156076e4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:10.803354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1187/2346] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:10.807433 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8589a-83ab-4329-8834-cb156076e4fa None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:10.816801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8589a-83ab-4329-8834-cb156076e4fa None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:10.821798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edfa22-ced4-4943-95e8-eb7b10df3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:10.824961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edfa22-ced4-4943-95e8-eb7b10df3f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:10.824961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edfa22-ced4-4943-95e8-eb7b10df3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:10.824961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edfa22-ced4-4943-95e8-eb7b10df3f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:10.824961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edfa22-ced4-4943-95e8-eb7b10df3f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:18:10.824961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edfa22-ced4-4943-95e8-eb7b10df3f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:10.825738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edfa22-ced4-4943-95e8-eb7b10df3f2f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:10.842761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1188/2347] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:18:10.843649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edfa22-ced4-4943-95e8-eb7b10df3f2f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:10.859749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edfa22-ced4-4943-95e8-eb7b10df3f2f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:10.875517 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1160/2348] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:18:10 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:10.885608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22342a-b0fa-48eb-bf6f-9c8fea4fab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:10.886238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22342a-b0fa-48eb-bf6f-9c8fea4fab65 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:10.886524 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22342a-b0fa-48eb-bf6f-9c8fea4fab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:10.888371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22342a-b0fa-48eb-bf6f-9c8fea4fab65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:10.888371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22342a-b0fa-48eb-bf6f-9c8fea4fab65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:10.888559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e003e4-2d43-46da-a59f-ff655d9e8382 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:10.890200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22342a-b0fa-48eb-bf6f-9c8fea4fab65 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:10.891863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e3e003e4-2d43-46da-a59f-ff655d9e8382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:10.981540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e003e4-2d43-46da-a59f-ff655d9e8382 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:10.987417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d5f26-2a09-46db-a9c7-d0e55dec7bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:10.988096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5f26-2a09-46db-a9c7-d0e55dec7bff admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:10.988377 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5f26-2a09-46db-a9c7-d0e55dec7bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:10.988647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5f26-2a09-46db-a9c7-d0e55dec7bff admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:10.989325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d5f26-2a09-46db-a9c7-d0e55dec7bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:10.991319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d5f26-2a09-46db-a9c7-d0e55dec7bff admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.004462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1189/2349] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:18:10 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:11.005764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22342a-b0fa-48eb-bf6f-9c8fea4fab65 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:11.105575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22342a-b0fa-48eb-bf6f-9c8fea4fab65 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:11.110761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ac59b-696b-4806-8826-921d3680af40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:11.111834 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ac59b-696b-4806-8826-921d3680af40 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.112206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ac59b-696b-4806-8826-921d3680af40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.112536 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ac59b-696b-4806-8826-921d3680af40 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.113285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ac59b-696b-4806-8826-921d3680af40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:11.115292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ac59b-696b-4806-8826-921d3680af40 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.121865 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1161/2350] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:18:10 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:18:11.123327 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d5f26-2a09-46db-a9c7-d0e55dec7bff admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:11.134472 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d5f26-2a09-46db-a9c7-d0e55dec7bff admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:11.139353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d28645-04ff-4503-9f1a-135e78261677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:11.140116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d28645-04ff-4503-9f1a-135e78261677 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.140452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d28645-04ff-4503-9f1a-135e78261677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.140797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d28645-04ff-4503-9f1a-135e78261677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.141626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d28645-04ff-4503-9f1a-135e78261677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:11.143340 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d28645-04ff-4503-9f1a-135e78261677 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.157439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1162/2351] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:18:11.160364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d28645-04ff-4503-9f1a-135e78261677 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:11.171117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d28645-04ff-4503-9f1a-135e78261677 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:11.179361 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e921c-2891-44cf-bc35-24a374c2e41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:11.180906 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e921c-2891-44cf-bc35-24a374c2e41d admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.181192 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e921c-2891-44cf-bc35-24a374c2e41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.181471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e921c-2891-44cf-bc35-24a374c2e41d admin admin] PATH_INFO: `/v3/projects/e011d38e61094c908888610db7e37aec/users/c010bb65be6d490c97d955d66261bdf5/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.197917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e921c-2891-44cf-bc35-24a374c2e41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e011d38e61094c908888610db7e37aec, user_id=c010bb65be6d490c97d955d66261bdf5, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:11.200763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e921c-2891-44cf-bc35-24a374c2e41d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.219330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1190/2352] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:18:11 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:18:11.220507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ac59b-696b-4806-8826-921d3680af40 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:11.232765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ac59b-696b-4806-8826-921d3680af40 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:11.238901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fcd9c-a9cd-46cf-9e95-d0e0447370cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:11.239922 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcd9c-a9cd-46cf-9e95-d0e0447370cb admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.240039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcd9c-a9cd-46cf-9e95-d0e0447370cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.240427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcd9c-a9cd-46cf-9e95-d0e0447370cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.241500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fcd9c-a9cd-46cf-9e95-d0e0447370cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:11.243194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fcd9c-a9cd-46cf-9e95-d0e0447370cb admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.256651 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1191/2353] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:18:11.257855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fcd9c-a9cd-46cf-9e95-d0e0447370cb admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:11.269232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1163/2354] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:18:11 2022] PUT /identity/v3/projects/e011d38e61094c908888610db7e37aec/users/c010bb65be6d490c97d955d66261bdf5/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:18:11.275994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e921c-2891-44cf-bc35-24a374c2e41d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:11.282324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fcd9c-a9cd-46cf-9e95-d0e0447370cb admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:11.352120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e921c-2891-44cf-bc35-24a374c2e41d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:11.358484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ae040-08d9-4d2e-be9d-4e0f36757be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:11.359133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae040-08d9-4d2e-be9d-4e0f36757be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.359555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae040-08d9-4d2e-be9d-4e0f36757be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.359663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae040-08d9-4d2e-be9d-4e0f36757be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.360373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ae040-08d9-4d2e-be9d-4e0f36757be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:11.362026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ae040-08d9-4d2e-be9d-4e0f36757be9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.373851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83766-6502-4c3f-b6d1-0f7fd8ab5ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:11.374636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83766-6502-4c3f-b6d1-0f7fd8ab5ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.377288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83766-6502-4c3f-b6d1-0f7fd8ab5ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.377288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83766-6502-4c3f-b6d1-0f7fd8ab5ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.377288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b83766-6502-4c3f-b6d1-0f7fd8ab5ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:11.377797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1164/2355] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:18:11.378408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b83766-6502-4c3f-b6d1-0f7fd8ab5ff2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.383133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ae040-08d9-4d2e-be9d-4e0f36757be9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:11.393000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1192/2356] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:18:11.397402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ae040-08d9-4d2e-be9d-4e0f36757be9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:11.399077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83766-6502-4c3f-b6d1-0f7fd8ab5ff2 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:11.402838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd229653-56e3-49b2-b79b-3f4f1344eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:11.404536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd229653-56e3-49b2-b79b-3f4f1344eaba admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.405055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd229653-56e3-49b2-b79b-3f4f1344eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.405343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd229653-56e3-49b2-b79b-3f4f1344eaba admin admin] PATH_INFO: `/v3/projects/e011d38e61094c908888610db7e37aec/users/c010bb65be6d490c97d955d66261bdf5/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.409031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd229653-56e3-49b2-b79b-3f4f1344eaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e011d38e61094c908888610db7e37aec, user_id=c010bb65be6d490c97d955d66261bdf5, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:11.411951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd229653-56e3-49b2-b79b-3f4f1344eaba admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.412733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83766-6502-4c3f-b6d1-0f7fd8ab5ff2 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:11.427324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c3100-837f-46e4-b9d9-858999536ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:11.428374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1165/2357] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:18:11 2022] PUT /identity/v3/projects/e011d38e61094c908888610db7e37aec/users/c010bb65be6d490c97d955d66261bdf5/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:11.432685 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c3100-837f-46e4-b9d9-858999536ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.433019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c3100-837f-46e4-b9d9-858999536ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.433770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c3100-837f-46e4-b9d9-858999536ad3 admin admin] PATH_INFO: `/v3/projects/aa229479746f4f9cbe2ec311b49ef762/users/896a792e9d8e4831bc05747bdf95fb43/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.456629 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c3100-837f-46e4-b9d9-858999536ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa229479746f4f9cbe2ec311b49ef762, user_id=896a792e9d8e4831bc05747bdf95fb43, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:11.459499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c3100-837f-46e4-b9d9-858999536ad3 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.565926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1193/2358] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:18:11 2022] PUT /identity/v3/projects/aa229479746f4f9cbe2ec311b49ef762/users/896a792e9d8e4831bc05747bdf95fb43/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:11.578177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c4ef-729f-4dcf-b8da-21a18fbc4a2b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.578995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c4ef-729f-4dcf-b8da-21a18fbc4a2b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.578995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c4ef-729f-4dcf-b8da-21a18fbc4a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.651048 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8917c4ef-729f-4dcf-b8da-21a18fbc4a2b None None] MFA Rules not processed for user `896a792e9d8e4831bc05747bdf95fb43`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:11.652306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8917c4ef-729f-4dcf-b8da-21a18fbc4a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:11.752763 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1166/2359] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:11.764214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c3100-837f-46e4-b9d9-858999536ad3 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:11.767191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fa1c3100-837f-46e4-b9d9-858999536ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:11.885135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c3100-837f-46e4-b9d9-858999536ad3 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:11.893154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198eb8a-6200-42b7-9cae-6ac59d599f9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:11.894471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198eb8a-6200-42b7-9cae-6ac59d599f9d service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:11.900327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198eb8a-6200-42b7-9cae-6ac59d599f9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:11.900327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198eb8a-6200-42b7-9cae-6ac59d599f9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:11.906931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198eb8a-6200-42b7-9cae-6ac59d599f9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:11.909680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198eb8a-6200-42b7-9cae-6ac59d599f9d service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:11.923101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1194/2360] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:18:16.765660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917c4ef-729f-4dcf-b8da-21a18fbc4a2b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:16.767173 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8917c4ef-729f-4dcf-b8da-21a18fbc4a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:16.859588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917c4ef-729f-4dcf-b8da-21a18fbc4a2b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:16.864212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:16.865201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:16.865487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:16.865762 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] PATH_INFO: `/v3/users/55fd7588cb5d45a3becfdc75f7b35497` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:16.867589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fd7588cb5d45a3becfdc75f7b35497)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:16.869540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:17.098019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fd7588cb5d45a3becfdc75f7b35497'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:17.098716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fd7588cb5d45a3becfdc75f7b35497'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:17.112120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fd7588cb5d45a3becfdc75f7b35497'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:17.112999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fd7588cb5d45a3becfdc75f7b35497'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:17.121287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fd7588cb5d45a3becfdc75f7b35497'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:17.196789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1167/2361] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:18:16 2022] DELETE /identity/v3/users/55fd7588cb5d45a3becfdc75f7b35497 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:17.201431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d6e69-661e-4fce-9943-f41e2d74e970 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:17.201933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d6e69-661e-4fce-9943-f41e2d74e970 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:17.202027 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d6e69-661e-4fce-9943-f41e2d74e970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:17.220566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-566d6e69-661e-4fce-9943-f41e2d74e970 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:17.221782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-566d6e69-661e-4fce-9943-f41e2d74e970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:17.282725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1195/2362] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:17.293139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:17.294699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:17.368494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5a1a5-27ab-44fe-919f-d5e9cbe84183 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:17.383391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a747175-c4ee-4143-9b94-7c49043b4f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:17.384143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747175-c4ee-4143-9b94-7c49043b4f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:17.387976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747175-c4ee-4143-9b94-7c49043b4f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:17.388470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747175-c4ee-4143-9b94-7c49043b4f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:17.423014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a747175-c4ee-4143-9b94-7c49043b4f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:17.424600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a747175-c4ee-4143-9b94-7c49043b4f58 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:17.436780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1168/2363] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:18:17.799578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d584-4f78-41d5-854a-9860836bc434 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:17.800131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d584-4f78-41d5-854a-9860836bc434 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:17.800587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d584-4f78-41d5-854a-9860836bc434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:17.837289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-71c3d584-4f78-41d5-854a-9860836bc434 None None] MFA Rules not processed for user `c010bb65be6d490c97d955d66261bdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:17.838871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-71c3d584-4f78-41d5-854a-9860836bc434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:17.930648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1196/2364] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:17.948435 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a747175-c4ee-4143-9b94-7c49043b4f58 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:17.950120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4a747175-c4ee-4143-9b94-7c49043b4f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:18.002682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3d584-4f78-41d5-854a-9860836bc434 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:18.006298 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-71c3d584-4f78-41d5-854a-9860836bc434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:18.027048 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3d584-4f78-41d5-854a-9860836bc434 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:18.034755 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:18.035821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:18.036154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:18.036554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] PATH_INFO: `/v3/projects/761f4aefe19c40e385235f8930c70937` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:18.038198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=761f4aefe19c40e385235f8930c70937)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:18.040824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:18.088124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a747175-c4ee-4143-9b94-7c49043b4f58 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:18.095233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa2ab-fbb7-40d5-92e7-7730a2215894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:18.095900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa2ab-fbb7-40d5-92e7-7730a2215894 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:18.096183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa2ab-fbb7-40d5-92e7-7730a2215894 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:18.096641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa2ab-fbb7-40d5-92e7-7730a2215894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:18.098708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b1eaa2ab-fbb7-40d5-92e7-7730a2215894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:18.159915 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaa2ab-fbb7-40d5-92e7-7730a2215894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:18.161342 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaa2ab-fbb7-40d5-92e7-7730a2215894 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:18.173023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1169/2365] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:18:18.208681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761f4aefe19c40e385235f8930c70937', 'request_id': 'req-327b767a-3d3c-46d4-aac8-2430f71b1d6a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.294316 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761f4aefe19c40e385235f8930c70937', 'request_id': 'req-327b767a-3d3c-46d4-aac8-2430f71b1d6a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.300121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761f4aefe19c40e385235f8930c70937', 'request_id': 'req-327b767a-3d3c-46d4-aac8-2430f71b1d6a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.312259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] The token cache is being invalidate because project 761f4aefe19c40e385235f8930c70937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:18:18.312623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.313283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.314951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1197/2366] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:18:17 2022] DELETE /identity/v3/projects/761f4aefe19c40e385235f8930c70937 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:18:18.319308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa2ab-fbb7-40d5-92e7-7730a2215894 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:18.330322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa2ab-fbb7-40d5-92e7-7730a2215894 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:18.384618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:18.385483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:18.385783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:18.386073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] PATH_INFO: `/v3/users/5a1b0c7864e24756995ddd5cffe268de` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:18.387259 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1b0c7864e24756995ddd5cffe268de)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:18.389179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:18.601706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1b0c7864e24756995ddd5cffe268de'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.603214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1b0c7864e24756995ddd5cffe268de'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.614806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1b0c7864e24756995ddd5cffe268de'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.615471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1b0c7864e24756995ddd5cffe268de'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.621997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1b0c7864e24756995ddd5cffe268de'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:18.703149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1170/2367] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:18:18 2022] DELETE /identity/v3/users/5a1b0c7864e24756995ddd5cffe268de => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:19.165076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:19.166582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:19.180184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b767a-3d3c-46d4-aac8-2430f71b1d6a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:19.243227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:19.243227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:19.243227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:19.243227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] PATH_INFO: `/v3/projects/3810f30331bb4dc09584190d6a5660a3` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:19.244021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3810f30331bb4dc09584190d6a5660a3)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:19.244021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:19.337036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3810f30331bb4dc09584190d6a5660a3', 'request_id': 'req-26dcb95b-9705-42c3-88ad-79840ca49b1a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.409438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3810f30331bb4dc09584190d6a5660a3', 'request_id': 'req-26dcb95b-9705-42c3-88ad-79840ca49b1a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.415890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3810f30331bb4dc09584190d6a5660a3', 'request_id': 'req-26dcb95b-9705-42c3-88ad-79840ca49b1a'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.426971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] The token cache is being invalidate because project 3810f30331bb4dc09584190d6a5660a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:18:19.427251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.427875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.430523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1198/2368] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:18:19 2022] DELETE /identity/v3/projects/3810f30331bb4dc09584190d6a5660a3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:19.434740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:19.436161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:19.449353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce29e18-b95f-476f-ae84-3658345478ee admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:19.508692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:19.509663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:19.510144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:19.510456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] PATH_INFO: `/v3/users/8f590808dfb6457593203a02f534bf72` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:19.511669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f590808dfb6457593203a02f534bf72)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:19.513595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:19.703220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f590808dfb6457593203a02f534bf72'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.703883 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f590808dfb6457593203a02f534bf72'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.716101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f590808dfb6457593203a02f534bf72'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.717663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f590808dfb6457593203a02f534bf72'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.724984 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f590808dfb6457593203a02f534bf72'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:19.798417 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1171/2369] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:18:19 2022] DELETE /identity/v3/users/8f590808dfb6457593203a02f534bf72 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:20.211094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:20.212562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:20.226294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcb95b-9705-42c3-88ad-79840ca49b1a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:20.285365 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:20.286254 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:20.286533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:20.286811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] PATH_INFO: `/v3/projects/100be48c6d5643efb8f6c623e4d4384d` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:20.288159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100be48c6d5643efb8f6c623e4d4384d)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:20.290223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:20.415517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100be48c6d5643efb8f6c623e4d4384d', 'request_id': 'req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:20.529202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100be48c6d5643efb8f6c623e4d4384d', 'request_id': 'req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:20.537372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100be48c6d5643efb8f6c623e4d4384d', 'request_id': 'req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:20.546711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] The token cache is being invalidate because project 100be48c6d5643efb8f6c623e4d4384d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:18:20.547001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:20.547670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6329f67e-bfd5-43be-8017-2f7bc07b6ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:20.549278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1199/2370] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:18:20 2022] DELETE /identity/v3/projects/100be48c6d5643efb8f6c623e4d4384d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:18:22.154657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:22.156633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:22.236902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776304f3-dcd0-4e22-8adc-7341a6c45a6c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:22.308341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:22.310907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:22.311311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:22.311601 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:22.313662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:22.388579 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:22.390196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:22.402013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1172/2371] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:18:42.957880 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea975a7-fb85-440e-b964-f1d9b96cd076 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:42.958440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea975a7-fb85-440e-b964-f1d9b96cd076 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:42.958542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea975a7-fb85-440e-b964-f1d9b96cd076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:42.976014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-aea975a7-fb85-440e-b964-f1d9b96cd076 None None] MFA Rules not processed for user `b34f24054c204d7cb69ca41099913ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:18:42.981431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-aea975a7-fb85-440e-b964-f1d9b96cd076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:43.030602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1200/2372] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:18:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:18:45.275940 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:45.277355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:45.362692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c39e7-0b4b-4ac4-9927-5eab0b85b4a9 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:45.367699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdf8ba-bec3-4928-8c29-181fa8dffa56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dfdb39ae2804b2191cea53f2a387c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:45.368337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdf8ba-bec3-4928-8c29-181fa8dffa56 service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:45.368618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdf8ba-bec3-4928-8c29-181fa8dffa56 service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:45.369338 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdf8ba-bec3-4928-8c29-181fa8dffa56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:45.370690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9efdf8ba-bec3-4928-8c29-181fa8dffa56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:45.381552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdf8ba-bec3-4928-8c29-181fa8dffa56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:45.383146 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efdf8ba-bec3-4928-8c29-181fa8dffa56 service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:45.392464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1173/2373] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:18:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:18:59.654489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea975a7-fb85-440e-b964-f1d9b96cd076 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:18:59.655892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-aea975a7-fb85-440e-b964-f1d9b96cd076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:18:59.717566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea975a7-fb85-440e-b964-f1d9b96cd076 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:18:59.722034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:18:59.722994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:18:59.723278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:18:59.723553 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] PATH_INFO: `/v3/users/896a792e9d8e4831bc05747bdf95fb43` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:18:59.725276 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896a792e9d8e4831bc05747bdf95fb43)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:18:59.727308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:18:59.940904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896a792e9d8e4831bc05747bdf95fb43'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:59.941609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896a792e9d8e4831bc05747bdf95fb43'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:59.942356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896a792e9d8e4831bc05747bdf95fb43'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:59.953845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896a792e9d8e4831bc05747bdf95fb43'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:18:59.960382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896a792e9d8e4831bc05747bdf95fb43'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:00.046315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1201/2374] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:18:59 2022] DELETE /identity/v3/users/896a792e9d8e4831bc05747bdf95fb43 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:19:00.050790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da8701-7fb1-4823-b83a-2b53ecc5e7e9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:00.051290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da8701-7fb1-4823-b83a-2b53ecc5e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:00.051406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da8701-7fb1-4823-b83a-2b53ecc5e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:00.071581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-62da8701-7fb1-4823-b83a-2b53ecc5e7e9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:00.072864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-62da8701-7fb1-4823-b83a-2b53ecc5e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:00.134267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1174/2375] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:00.143977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:00.145553 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:00.201870 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4474c85-51ee-4dd6-ba26-a19aac3f6eb5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:00.205503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bf421-8d84-4d59-8923-17cf77b19330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:00.206178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bf421-8d84-4d59-8923-17cf77b19330 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:00.206463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bf421-8d84-4d59-8923-17cf77b19330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:00.206739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bf421-8d84-4d59-8923-17cf77b19330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:00.216236 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bf421-8d84-4d59-8923-17cf77b19330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:00.217669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bf421-8d84-4d59-8923-17cf77b19330 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:00.228408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1202/2376] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:19:00.671180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da8701-7fb1-4823-b83a-2b53ecc5e7e9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:00.672688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-62da8701-7fb1-4823-b83a-2b53ecc5e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:00.685176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da8701-7fb1-4823-b83a-2b53ecc5e7e9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:00.690129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:00.691139 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:00.691380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:00.691662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] PATH_INFO: `/v3/projects/aa229479746f4f9cbe2ec311b49ef762` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:00.692859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa229479746f4f9cbe2ec311b49ef762)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:00.694824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:00.834843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa229479746f4f9cbe2ec311b49ef762', 'request_id': 'req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:00.841155 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa229479746f4f9cbe2ec311b49ef762', 'request_id': 'req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:00.846703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa229479746f4f9cbe2ec311b49ef762', 'request_id': 'req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:00.930780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] The token cache is being invalidate because project aa229479746f4f9cbe2ec311b49ef762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:19:00.931009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:00.931624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-33ab5727-3b6e-40ce-9ce0-0b3fcd0c8d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:00.933196 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1175/2377] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:19:00 2022] DELETE /identity/v3/projects/aa229479746f4f9cbe2ec311b49ef762 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:19:00.938142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28134c64-40a9-4fa5-b4f6-56b855beb4f5 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:00.938855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28134c64-40a9-4fa5-b4f6-56b855beb4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:00.938961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28134c64-40a9-4fa5-b4f6-56b855beb4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:00.955975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-28134c64-40a9-4fa5-b4f6-56b855beb4f5 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:00.957160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-28134c64-40a9-4fa5-b4f6-56b855beb4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:01.017883 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1203/2378] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:01.026981 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12adfd-2444-4431-b818-21579cbba6e6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:01.027377 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12adfd-2444-4431-b818-21579cbba6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:01.027663 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12adfd-2444-4431-b818-21579cbba6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:01.046994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bf12adfd-2444-4431-b818-21579cbba6e6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:01.048334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bf12adfd-2444-4431-b818-21579cbba6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:01.057041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1176/2379] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:01.061201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28134c64-40a9-4fa5-b4f6-56b855beb4f5 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:01.072141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28134c64-40a9-4fa5-b4f6-56b855beb4f5 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:01.086376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0665d-a994-4c4f-a46e-0ae8284c20d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:01.087205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0665d-a994-4c4f-a46e-0ae8284c20d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:01.087582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0665d-a994-4c4f-a46e-0ae8284c20d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:01.087953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0665d-a994-4c4f-a46e-0ae8284c20d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:01.088841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0665d-a994-4c4f-a46e-0ae8284c20d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:19:01.089505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0665d-a994-4c4f-a46e-0ae8284c20d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:01.091463 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0665d-a994-4c4f-a46e-0ae8284c20d5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:01.105023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1204/2380] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:19:01.109115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12adfd-2444-4431-b818-21579cbba6e6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:01.118311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12adfd-2444-4431-b818-21579cbba6e6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:01.122884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141d7d-ad26-4284-8ec6-7e4a8a28c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:01.123524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141d7d-ad26-4284-8ec6-7e4a8a28c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:01.123803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141d7d-ad26-4284-8ec6-7e4a8a28c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:01.124071 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141d7d-ad26-4284-8ec6-7e4a8a28c3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:01.124743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01141d7d-ad26-4284-8ec6-7e4a8a28c3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:01.126669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01141d7d-ad26-4284-8ec6-7e4a8a28c3f1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:01.250593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1177/2381] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:19:01 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:19:01.251854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0665d-a994-4c4f-a46e-0ae8284c20d5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:01.261691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0665d-a994-4c4f-a46e-0ae8284c20d5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:01.317313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bd9b3-59c8-40fc-88e7-5974ecadd736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:01.317977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bd9b3-59c8-40fc-88e7-5974ecadd736 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:01.318294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bd9b3-59c8-40fc-88e7-5974ecadd736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:01.318572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bd9b3-59c8-40fc-88e7-5974ecadd736 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:01.319259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bd9b3-59c8-40fc-88e7-5974ecadd736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:01.321171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bd9b3-59c8-40fc-88e7-5974ecadd736 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:01.471936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1205/2382] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:19:01 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:19:01.473823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141d7d-ad26-4284-8ec6-7e4a8a28c3f1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:01.485066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141d7d-ad26-4284-8ec6-7e4a8a28c3f1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:01.489851 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50223-acd8-4580-bf5d-ec02f8b234c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:01.491214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50223-acd8-4580-bf5d-ec02f8b234c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:01.491562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50223-acd8-4580-bf5d-ec02f8b234c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:01.491901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50223-acd8-4580-bf5d-ec02f8b234c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:01.492722 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b50223-acd8-4580-bf5d-ec02f8b234c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:01.494407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b50223-acd8-4580-bf5d-ec02f8b234c9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:01.504922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1178/2383] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:19:01.517166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bd9b3-59c8-40fc-88e7-5974ecadd736 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:01.527654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bd9b3-59c8-40fc-88e7-5974ecadd736 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:01.532301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b62b6-8019-4737-a226-4af1b2309749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:01.533028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b62b6-8019-4737-a226-4af1b2309749 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:01.533308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b62b6-8019-4737-a226-4af1b2309749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:01.533577 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b62b6-8019-4737-a226-4af1b2309749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:01.534343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b62b6-8019-4737-a226-4af1b2309749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:01.535943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b62b6-8019-4737-a226-4af1b2309749 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:01.546525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1206/2384] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:19:01.551546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50223-acd8-4580-bf5d-ec02f8b234c9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:01.564866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50223-acd8-4580-bf5d-ec02f8b234c9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:01.575012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52931d37-8682-4518-a413-60ea3ddae836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:01.575893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52931d37-8682-4518-a413-60ea3ddae836 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:01.576176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52931d37-8682-4518-a413-60ea3ddae836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:01.576452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52931d37-8682-4518-a413-60ea3ddae836 admin admin] PATH_INFO: `/v3/projects/a7a81cdda2b24d85a96f06585868e8f9/users/94afa342faf7484a9ffb830db20d24d4/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:01.591388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52931d37-8682-4518-a413-60ea3ddae836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a81cdda2b24d85a96f06585868e8f9, user_id=94afa342faf7484a9ffb830db20d24d4, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:01.594202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52931d37-8682-4518-a413-60ea3ddae836 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:01.670478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1179/2385] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:19:01 2022] PUT /identity/v3/projects/a7a81cdda2b24d85a96f06585868e8f9/users/94afa342faf7484a9ffb830db20d24d4/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:19:01.681428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd9da-687c-452b-9d1a-979795489b66 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:01.681737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd9da-687c-452b-9d1a-979795489b66 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:01.681983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd9da-687c-452b-9d1a-979795489b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:01.711565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d99bd9da-687c-452b-9d1a-979795489b66 None None] MFA Rules not processed for user `94afa342faf7484a9ffb830db20d24d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:01.713018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d99bd9da-687c-452b-9d1a-979795489b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:01.782187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1207/2386] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:01.791413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52931d37-8682-4518-a413-60ea3ddae836 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:01.794223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-52931d37-8682-4518-a413-60ea3ddae836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:01.861869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52931d37-8682-4518-a413-60ea3ddae836 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:01.866169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d781a4-084f-47b7-8625-476806575ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:01.866989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d781a4-084f-47b7-8625-476806575ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:01.867298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d781a4-084f-47b7-8625-476806575ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:01.867585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d781a4-084f-47b7-8625-476806575ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:01.877201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d781a4-084f-47b7-8625-476806575ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:01.878814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d781a4-084f-47b7-8625-476806575ea0 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:01.889385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1180/2387] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:19:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:03.673719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32ae0f-189f-4d76-9292-c20ec47ad152 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:03.674340 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32ae0f-189f-4d76-9292-c20ec47ad152 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:03.674461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32ae0f-189f-4d76-9292-c20ec47ad152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:03.692146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-5b32ae0f-189f-4d76-9292-c20ec47ad152 None None] MFA Rules not processed for user `94afa342faf7484a9ffb830db20d24d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:03.693862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5b32ae0f-189f-4d76-9292-c20ec47ad152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:03.701192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1208/2388] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:04.237089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d781a4-084f-47b7-8625-476806575ea0 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:04.238600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-15d781a4-084f-47b7-8625-476806575ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:04.303823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d781a4-084f-47b7-8625-476806575ea0 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:04.308159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9e26-3763-4269-a481-f04d23db7672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:04.308861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9e26-3763-4269-a481-f04d23db7672 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:04.309213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9e26-3763-4269-a481-f04d23db7672 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:04.309514 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9e26-3763-4269-a481-f04d23db7672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:04.311869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a07d9e26-3763-4269-a481-f04d23db7672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:04.413637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d9e26-3763-4269-a481-f04d23db7672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:04.415552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d9e26-3763-4269-a481-f04d23db7672 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:04.431937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1181/2389] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:19:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:18.720527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699cf7-190e-4592-a2ce-9253349b68b9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:18.726409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699cf7-190e-4592-a2ce-9253349b68b9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:18.726409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699cf7-190e-4592-a2ce-9253349b68b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:18.738336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d4699cf7-190e-4592-a2ce-9253349b68b9 None None] MFA Rules not processed for user `44ffd5660baa40a7a3d6918cb5d31e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:18.740162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d4699cf7-190e-4592-a2ce-9253349b68b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:18.793695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1209/2390] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:23.479833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccbe4b-2a22-4829-b760-940af140091a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:23.480332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccbe4b-2a22-4829-b760-940af140091a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:23.480449 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccbe4b-2a22-4829-b760-940af140091a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:23.497387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-47ccbe4b-2a22-4829-b760-940af140091a None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:23.499065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-47ccbe4b-2a22-4829-b760-940af140091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:23.553204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1182/2391] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:19:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:23.720686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4699cf7-190e-4592-a2ce-9253349b68b9 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:23.720686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d4699cf7-190e-4592-a2ce-9253349b68b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:23.796287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4699cf7-190e-4592-a2ce-9253349b68b9 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:23.802611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef06272-fbde-46d3-bf62-a7a499ed10e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:23.803382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef06272-fbde-46d3-bf62-a7a499ed10e8 service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:23.803738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef06272-fbde-46d3-bf62-a7a499ed10e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:23.804088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef06272-fbde-46d3-bf62-a7a499ed10e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:23.814183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef06272-fbde-46d3-bf62-a7a499ed10e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:23.816697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef06272-fbde-46d3-bf62-a7a499ed10e8 service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:23.830335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1210/2392] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:19:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:19:24.670901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff311ef-fef6-4e96-839b-ddc7e83dfb4e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:24.671320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff311ef-fef6-4e96-839b-ddc7e83dfb4e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:24.671466 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff311ef-fef6-4e96-839b-ddc7e83dfb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:24.689909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3ff311ef-fef6-4e96-839b-ddc7e83dfb4e None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:24.691225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3ff311ef-fef6-4e96-839b-ddc7e83dfb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:24.698582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1183/2393] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 16 15:19:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:24.711345 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef06272-fbde-46d3-bf62-a7a499ed10e8 service swift] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:24.721675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef06272-fbde-46d3-bf62-a7a499ed10e8 service swift] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:24.727234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d10d6-385a-4f54-ac82-2a2bd006684f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:24.727958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d10d6-385a-4f54-ac82-2a2bd006684f service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:24.728317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d10d6-385a-4f54-ac82-2a2bd006684f service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:24.728656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d10d6-385a-4f54-ac82-2a2bd006684f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:24.736839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d10d6-385a-4f54-ac82-2a2bd006684f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:24.739141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d10d6-385a-4f54-ac82-2a2bd006684f service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:24.747336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1211/2394] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:19:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:19:25.333496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776d00-9887-482e-a8d5-531cae92425a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:25.333856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776d00-9887-482e-a8d5-531cae92425a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:25.334254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776d00-9887-482e-a8d5-531cae92425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:25.351711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-76776d00-9887-482e-a8d5-531cae92425a None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:25.352990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-76776d00-9887-482e-a8d5-531cae92425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:25.360765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1184/2395] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:19:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:25.372611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d10d6-385a-4f54-ac82-2a2bd006684f service swift] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:25.383496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d10d6-385a-4f54-ac82-2a2bd006684f service swift] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:25.390643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe18f6-02c6-4ce4-8af0-15ae176575d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:25.391285 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe18f6-02c6-4ce4-8af0-15ae176575d1 service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:25.391566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe18f6-02c6-4ce4-8af0-15ae176575d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:25.391947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe18f6-02c6-4ce4-8af0-15ae176575d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:25.400753 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe18f6-02c6-4ce4-8af0-15ae176575d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:25.402390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe18f6-02c6-4ce4-8af0-15ae176575d1 service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:25.410227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1212/2396] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:19:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:19:25.983536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20350681-be73-42e4-aeed-7154528fc269 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:25.988693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20350681-be73-42e4-aeed-7154528fc269 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:25.988693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20350681-be73-42e4-aeed-7154528fc269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:26.001876 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-20350681-be73-42e4-aeed-7154528fc269 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:26.003099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-20350681-be73-42e4-aeed-7154528fc269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:26.010409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1185/2397] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 16 15:19:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:19:26.022470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe18f6-02c6-4ce4-8af0-15ae176575d1 service swift] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:26.032826 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe18f6-02c6-4ce4-8af0-15ae176575d1 service swift] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:26.038431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56764413-f09f-4f0f-8aed-f74325b08d69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:26.039090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56764413-f09f-4f0f-8aed-f74325b08d69 service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:26.039375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56764413-f09f-4f0f-8aed-f74325b08d69 service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:26.039648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56764413-f09f-4f0f-8aed-f74325b08d69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:26.047638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56764413-f09f-4f0f-8aed-f74325b08d69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:26.049249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56764413-f09f-4f0f-8aed-f74325b08d69 service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:26.057778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1213/2398] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:19:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:19:28.616921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20350681-be73-42e4-aeed-7154528fc269 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:28.675812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20350681-be73-42e4-aeed-7154528fc269 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:28.680271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:28.681123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:28.681406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:28.681675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] PATH_INFO: `/v3/users/94afa342faf7484a9ffb830db20d24d4` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:28.682880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94afa342faf7484a9ffb830db20d24d4)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:28.684820 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:28.900061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94afa342faf7484a9ffb830db20d24d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:28.906287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94afa342faf7484a9ffb830db20d24d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:28.913774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94afa342faf7484a9ffb830db20d24d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:28.914606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94afa342faf7484a9ffb830db20d24d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:28.921498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94afa342faf7484a9ffb830db20d24d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:28.969207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1186/2399] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:19:28 2022] DELETE /identity/v3/users/94afa342faf7484a9ffb830db20d24d4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:19:28.973856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca653dca-42d3-481b-8836-805f6b47809b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:28.975638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca653dca-42d3-481b-8836-805f6b47809b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:28.975638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca653dca-42d3-481b-8836-805f6b47809b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:28.992951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ca653dca-42d3-481b-8836-805f6b47809b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:28.994297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ca653dca-42d3-481b-8836-805f6b47809b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:29.054108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1214/2400] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:29.063823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:29.065199 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:29.121416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c3fea-e44e-4864-b1ad-739aeeeda6f1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:29.125041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e0722-94c9-4b98-9579-ef3ea6fc9d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:29.125695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e0722-94c9-4b98-9579-ef3ea6fc9d4e service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:29.125954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e0722-94c9-4b98-9579-ef3ea6fc9d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:29.126253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e0722-94c9-4b98-9579-ef3ea6fc9d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:29.135753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e0722-94c9-4b98-9579-ef3ea6fc9d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:29.137105 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e0722-94c9-4b98-9579-ef3ea6fc9d4e service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:29.146958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1187/2401] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:29.405276 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca653dca-42d3-481b-8836-805f6b47809b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:29.406743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ca653dca-42d3-481b-8836-805f6b47809b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:29.419140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca653dca-42d3-481b-8836-805f6b47809b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:29.423856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:29.424699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:29.424975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:29.425375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] PATH_INFO: `/v3/projects/a7a81cdda2b24d85a96f06585868e8f9` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:29.426516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a81cdda2b24d85a96f06585868e8f9)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:29.428409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:29.517528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a81cdda2b24d85a96f06585868e8f9', 'request_id': 'req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:29.581391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a81cdda2b24d85a96f06585868e8f9', 'request_id': 'req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:29.588047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a81cdda2b24d85a96f06585868e8f9', 'request_id': 'req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:29.599818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] The token cache is being invalidate because project a7a81cdda2b24d85a96f06585868e8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:19:29.600103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:29.600744 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3ed808e8-f59d-46cd-9d1d-acc2bdc9b97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:19:29.602305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1215/2402] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:19:29 2022] DELETE /identity/v3/projects/a7a81cdda2b24d85a96f06585868e8f9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:19:29.607180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264469c2-0096-448d-b653-99ca7d97959a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:29.607465 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264469c2-0096-448d-b653-99ca7d97959a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:29.607741 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264469c2-0096-448d-b653-99ca7d97959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:29.624509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-264469c2-0096-448d-b653-99ca7d97959a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:29.625684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-264469c2-0096-448d-b653-99ca7d97959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:29.683444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1188/2403] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:29.691187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cadd32-d823-48a6-8480-b03eea2ddfd6 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:29.691476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cadd32-d823-48a6-8480-b03eea2ddfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:29.691756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cadd32-d823-48a6-8480-b03eea2ddfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:29.710766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-90cadd32-d823-48a6-8480-b03eea2ddfd6 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:29.711967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-90cadd32-d823-48a6-8480-b03eea2ddfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:29.719913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1216/2404] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:29.724085 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264469c2-0096-448d-b653-99ca7d97959a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:29.733477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264469c2-0096-448d-b653-99ca7d97959a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:29.738002 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d7a0-60fc-49ce-8499-d444e1d7e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:29.738689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d7a0-60fc-49ce-8499-d444e1d7e0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:29.738972 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d7a0-60fc-49ce-8499-d444e1d7e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:29.739244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d7a0-60fc-49ce-8499-d444e1d7e0d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:29.739960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d7a0-60fc-49ce-8499-d444e1d7e0d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:19:29.740266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d7a0-60fc-49ce-8499-d444e1d7e0d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:29.741886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d7a0-60fc-49ce-8499-d444e1d7e0d8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:29.755077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1189/2405] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:19:29.759221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cadd32-d823-48a6-8480-b03eea2ddfd6 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:29.768345 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cadd32-d823-48a6-8480-b03eea2ddfd6 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:29.773547 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01c34-a481-41dc-95a8-1bc58c4f7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:29.774489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01c34-a481-41dc-95a8-1bc58c4f7485 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:29.774768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01c34-a481-41dc-95a8-1bc58c4f7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:29.775036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e01c34-a481-41dc-95a8-1bc58c4f7485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:29.775739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e01c34-a481-41dc-95a8-1bc58c4f7485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:29.777650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e01c34-a481-41dc-95a8-1bc58c4f7485 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:29.867930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1217/2406] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:19:29 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:19:29.872080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d7a0-60fc-49ce-8499-d444e1d7e0d8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:29.882537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d7a0-60fc-49ce-8499-d444e1d7e0d8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:29.944513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30f0c7-9563-4cfe-8878-0ce26c4b9683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:29.945122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f0c7-9563-4cfe-8878-0ce26c4b9683 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:29.945398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f0c7-9563-4cfe-8878-0ce26c4b9683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:29.945667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30f0c7-9563-4cfe-8878-0ce26c4b9683 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:29.946970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30f0c7-9563-4cfe-8878-0ce26c4b9683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:29.949597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30f0c7-9563-4cfe-8878-0ce26c4b9683 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:30.034044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1190/2407] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:19:29 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:19:30.037951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01c34-a481-41dc-95a8-1bc58c4f7485 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:30.048712 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e01c34-a481-41dc-95a8-1bc58c4f7485 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:30.054149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec430b03-1ef7-49d9-9bd4-9cd1ea9bb67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:30.054903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec430b03-1ef7-49d9-9bd4-9cd1ea9bb67f admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:30.055255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec430b03-1ef7-49d9-9bd4-9cd1ea9bb67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:30.055600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec430b03-1ef7-49d9-9bd4-9cd1ea9bb67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:30.056420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec430b03-1ef7-49d9-9bd4-9cd1ea9bb67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:30.058105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec430b03-1ef7-49d9-9bd4-9cd1ea9bb67f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:30.069673 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1218/2408] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:19:30.073658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30f0c7-9563-4cfe-8878-0ce26c4b9683 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:30.085005 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30f0c7-9563-4cfe-8878-0ce26c4b9683 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:30.089807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2ff4f-6e49-4795-81f6-1646de82cfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:30.090550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2ff4f-6e49-4795-81f6-1646de82cfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:30.090830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2ff4f-6e49-4795-81f6-1646de82cfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:30.091103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2ff4f-6e49-4795-81f6-1646de82cfe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:30.091826 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2ff4f-6e49-4795-81f6-1646de82cfe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:30.093559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2ff4f-6e49-4795-81f6-1646de82cfe3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:30.103398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1191/2409] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:19:30.107440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec430b03-1ef7-49d9-9bd4-9cd1ea9bb67f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:30.117602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec430b03-1ef7-49d9-9bd4-9cd1ea9bb67f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:30.122203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91431fbf-a0ce-4016-a773-2528384ffa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:30.123060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431fbf-a0ce-4016-a773-2528384ffa9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:30.123339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431fbf-a0ce-4016-a773-2528384ffa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:30.123612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431fbf-a0ce-4016-a773-2528384ffa9c admin admin] PATH_INFO: `/v3/projects/f6ec3267b0c548558b92318ec6179dca/users/d9e6e8acac7c447ba3885dcafb386050/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:30.137978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91431fbf-a0ce-4016-a773-2528384ffa9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ec3267b0c548558b92318ec6179dca, user_id=d9e6e8acac7c447ba3885dcafb386050, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:30.140631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91431fbf-a0ce-4016-a773-2528384ffa9c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:30.186760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1219/2410] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:19:30 2022] PUT /identity/v3/projects/f6ec3267b0c548558b92318ec6179dca/users/d9e6e8acac7c447ba3885dcafb386050/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:19:30.191967 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dfb03-d817-4365-b0bf-7c1393b51551 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:30.192835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dfb03-d817-4365-b0bf-7c1393b51551 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:30.193281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dfb03-d817-4365-b0bf-7c1393b51551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:30.211541 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c39dfb03-d817-4365-b0bf-7c1393b51551 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:30.212647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c39dfb03-d817-4365-b0bf-7c1393b51551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:30.272907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1192/2411] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:19:30.282534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91431fbf-a0ce-4016-a773-2528384ffa9c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:30.284129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-91431fbf-a0ce-4016-a773-2528384ffa9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:30.339216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91431fbf-a0ce-4016-a773-2528384ffa9c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:30.342828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b536-7223-44d9-b9c1-64449f322f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:30.343460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b536-7223-44d9-b9c1-64449f322f7e service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:30.343850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b536-7223-44d9-b9c1-64449f322f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:30.344125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b536-7223-44d9-b9c1-64449f322f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:30.353830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b536-7223-44d9-b9c1-64449f322f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:30.355300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b536-7223-44d9-b9c1-64449f322f7e service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:30.365291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1220/2412] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:31.776682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e8fb2-af54-4671-a82e-f9cb04efcd5e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:31.777168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e8fb2-af54-4671-a82e-f9cb04efcd5e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:31.777284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e8fb2-af54-4671-a82e-f9cb04efcd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:31.809815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-dc7e8fb2-af54-4671-a82e-f9cb04efcd5e None None] MFA Rules not processed for user `d9e6e8acac7c447ba3885dcafb386050`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:31.811078 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-dc7e8fb2-af54-4671-a82e-f9cb04efcd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:31.884223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1193/2413] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:19:31.895244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b536-7223-44d9-b9c1-64449f322f7e service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:19:31.896736 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-dca1b536-7223-44d9-b9c1-64449f322f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:31.951797 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b536-7223-44d9-b9c1-64449f322f7e service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:19:31.955402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c62d6b-281a-40c0-81d8-facdb3305614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:19:31.956042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62d6b-281a-40c0-81d8-facdb3305614 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:31.956326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62d6b-281a-40c0-81d8-facdb3305614 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:31.956602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c62d6b-281a-40c0-81d8-facdb3305614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:31.964697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c62d6b-281a-40c0-81d8-facdb3305614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:19:31.966150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c62d6b-281a-40c0-81d8-facdb3305614 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:19:31.974896 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1221/2414] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:19:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:19:33.758635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f570e-15aa-43ed-9d14-372fdb47483e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:33.759224 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f570e-15aa-43ed-9d14-372fdb47483e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:33.759224 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f570e-15aa-43ed-9d14-372fdb47483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:33.776014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-541f570e-15aa-43ed-9d14-372fdb47483e None None] MFA Rules not processed for user `d9e6e8acac7c447ba3885dcafb386050`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:33.777180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-541f570e-15aa-43ed-9d14-372fdb47483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:33.783898 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1194/2415] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:19:34.773373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191ac4-aee5-4bbd-a0d4-b7e6aa06aeaf None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:19:34.773906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191ac4-aee5-4bbd-a0d4-b7e6aa06aeaf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:19:34.773906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191ac4-aee5-4bbd-a0d4-b7e6aa06aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:19:34.790511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d0191ac4-aee5-4bbd-a0d4-b7e6aa06aeaf None None] MFA Rules not processed for user `a14795cb97ac44b2a7fc1e2f79b12253`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:19:34.791701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d0191ac4-aee5-4bbd-a0d4-b7e6aa06aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:19:34.850631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1222/2416] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:20:18.586595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f570e-15aa-43ed-9d14-372fdb47483e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:18.588003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-541f570e-15aa-43ed-9d14-372fdb47483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:18.599649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f570e-15aa-43ed-9d14-372fdb47483e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:18.603213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:18.603851 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:18.604134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:18.604410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:18.606097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:18.674922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:18.676768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:18.687444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1195/2417] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:20:22.186022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191ac4-aee5-4bbd-a0d4-b7e6aa06aeaf None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:22.196010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191ac4-aee5-4bbd-a0d4-b7e6aa06aeaf None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:22.199585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f54d8-1f92-49f7-bbec-da3d5562935c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:22.200220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f54d8-1f92-49f7-bbec-da3d5562935c service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:22.200502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f54d8-1f92-49f7-bbec-da3d5562935c service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:22.200777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f54d8-1f92-49f7-bbec-da3d5562935c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:22.203162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b12f54d8-1f92-49f7-bbec-da3d5562935c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:22.216213 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f54d8-1f92-49f7-bbec-da3d5562935c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:22.217639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f54d8-1f92-49f7-bbec-da3d5562935c service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:22.228412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1223/2418] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:20:25.687611 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:25.688998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:25.703108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dd48d-fb27-4ce1-8334-45b0b28df15a service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:25.708645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1af59-4962-4469-ba2c-94da86aca760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:25.709283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1af59-4962-4469-ba2c-94da86aca760 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:25.709566 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1af59-4962-4469-ba2c-94da86aca760 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:25.709843 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1af59-4962-4469-ba2c-94da86aca760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:25.711572 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-74e1af59-4962-4469-ba2c-94da86aca760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:25.768852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1af59-4962-4469-ba2c-94da86aca760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:25.770478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1af59-4962-4469-ba2c-94da86aca760 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:25.779587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1196/2419] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:20:29.568875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f54d8-1f92-49f7-bbec-da3d5562935c service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:29.577944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f54d8-1f92-49f7-bbec-da3d5562935c service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:29.581500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0e458-f341-4933-b417-a1e0f96dee92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:29.582157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e458-f341-4933-b417-a1e0f96dee92 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:29.582441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e458-f341-4933-b417-a1e0f96dee92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:29.582715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0e458-f341-4933-b417-a1e0f96dee92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:29.584489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-95e0e458-f341-4933-b417-a1e0f96dee92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:29.594916 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0e458-f341-4933-b417-a1e0f96dee92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:29.596327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0e458-f341-4933-b417-a1e0f96dee92 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:29.605400 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1224/2420] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:20:31.490148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1af59-4962-4469-ba2c-94da86aca760 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:31.505630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1af59-4962-4469-ba2c-94da86aca760 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:31.512160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:31.516913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:31.516913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:31.516913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:31.516913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:31.592326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:31.594393 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:31.605036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1197/2421] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:20:34.293600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a98adb-9384-45cf-9f92-1a6c59063b32 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:34.294130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a98adb-9384-45cf-9f92-1a6c59063b32 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:34.294275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a98adb-9384-45cf-9f92-1a6c59063b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:34.315863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-54a98adb-9384-45cf-9f92-1a6c59063b32 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:20:34.317495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-54a98adb-9384-45cf-9f92-1a6c59063b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:34.374593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1225/2422] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 16 15:20:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:20:34.488161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:34.489647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:34.556457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f87d4f-9ab0-4a58-a89a-f034b4b02785 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:34.561309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920922-6e31-4853-b9f9-49bc41b46686 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:34.561948 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920922-6e31-4853-b9f9-49bc41b46686 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:34.562275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920922-6e31-4853-b9f9-49bc41b46686 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:34.562544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a920922-6e31-4853-b9f9-49bc41b46686 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:34.570490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920922-6e31-4853-b9f9-49bc41b46686 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:34.572174 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a920922-6e31-4853-b9f9-49bc41b46686 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:34.580729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1198/2423] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:20:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:20:37.462587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dce98-a27d-4793-9850-de554d9c15b2 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:37.467431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dce98-a27d-4793-9850-de554d9c15b2 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:37.467431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dce98-a27d-4793-9850-de554d9c15b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:37.490130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e23dce98-a27d-4793-9850-de554d9c15b2 None None] MFA Rules not processed for user `911ef817a1ee4790ad97e857a299fb01`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:20:37.490130 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e23dce98-a27d-4793-9850-de554d9c15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:37.500080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1226/2424] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:20:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:20:38.106693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920922-6e31-4853-b9f9-49bc41b46686 service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:38.108084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1a920922-6e31-4853-b9f9-49bc41b46686 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:38.125636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a920922-6e31-4853-b9f9-49bc41b46686 service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:38.133383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb94c0-5f6b-4009-b53b-b453b0d3115d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:38.134751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb94c0-5f6b-4009-b53b-b453b0d3115d service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:38.135277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb94c0-5f6b-4009-b53b-b453b0d3115d service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:38.136177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb94c0-5f6b-4009-b53b-b453b0d3115d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:38.139670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8efb94c0-5f6b-4009-b53b-b453b0d3115d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:38.158608 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb94c0-5f6b-4009-b53b-b453b0d3115d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:38.162493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb94c0-5f6b-4009-b53b-b453b0d3115d service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:38.189688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1199/2425] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:20:38.780149 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dce98-a27d-4793-9850-de554d9c15b2 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:38.781322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e23dce98-a27d-4793-9850-de554d9c15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:38.910688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dce98-a27d-4793-9850-de554d9c15b2 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:38.916355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dfdb39ae2804b2191cea53f2a387c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:38.922618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:38.922618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:38.922618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:38.923944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:38.992277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:38.994223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:39.031425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1227/2426] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:20:43.090901 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb94c0-5f6b-4009-b53b-b453b0d3115d service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:43.102756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb94c0-5f6b-4009-b53b-b453b0d3115d service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:43.107701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ed078-39cd-4a2a-9b8f-7af68ddf7a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:43.108639 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ed078-39cd-4a2a-9b8f-7af68ddf7a1a service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:43.109008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ed078-39cd-4a2a-9b8f-7af68ddf7a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:43.109389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ed078-39cd-4a2a-9b8f-7af68ddf7a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:43.111515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-081ed078-39cd-4a2a-9b8f-7af68ddf7a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:43.122956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ed078-39cd-4a2a-9b8f-7af68ddf7a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:43.124594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ed078-39cd-4a2a-9b8f-7af68ddf7a1a service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:43.133288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1200/2427] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:20:44.773557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:44.775839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:44.790926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02f7bf-d9d2-41b2-86ac-357521033a9d service placement] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:44.797838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:44.798841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:44.799188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:44.799528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] PATH_INFO: `/v3/users/064ef0ac470b458ba5a675364f9cab31` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:44.800780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] RBAC: Authorizing `identity:delete_user(user_id=064ef0ac470b458ba5a675364f9cab31)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:44.802901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:44.975339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064ef0ac470b458ba5a675364f9cab31'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:44.976282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064ef0ac470b458ba5a675364f9cab31'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:44.979810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064ef0ac470b458ba5a675364f9cab31'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:44.997360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064ef0ac470b458ba5a675364f9cab31'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:45.015618 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064ef0ac470b458ba5a675364f9cab31'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:45.096116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1228/2428] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:20:44 2022] DELETE /identity/v3/users/064ef0ac470b458ba5a675364f9cab31 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:20:45.578509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ed078-39cd-4a2a-9b8f-7af68ddf7a1a service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:45.592954 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ed078-39cd-4a2a-9b8f-7af68ddf7a1a service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:45.651324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:45.652213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:45.652523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:45.653312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] PATH_INFO: `/v3/projects/18afd7d9815342c196be824d2b99d537` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:45.654515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18afd7d9815342c196be824d2b99d537)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:45.656441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:45.834446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18afd7d9815342c196be824d2b99d537', 'request_id': 'req-d9638120-f815-4369-9a40-2db753eec605'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:45.841487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18afd7d9815342c196be824d2b99d537', 'request_id': 'req-d9638120-f815-4369-9a40-2db753eec605'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:45.846881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18afd7d9815342c196be824d2b99d537', 'request_id': 'req-d9638120-f815-4369-9a40-2db753eec605'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:45.890568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] The token cache is being invalidate because project 18afd7d9815342c196be824d2b99d537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:20:45.890793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:45.891408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:45.892976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1201/2429] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:20:45 2022] DELETE /identity/v3/projects/18afd7d9815342c196be824d2b99d537 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:20:45.897080 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:45.898546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:45.912017 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc305186-a263-4e61-a972-1d5dd053819d admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:45.965407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:45.966280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:45.966557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:45.966827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] PATH_INFO: `/v3/users/3e186a9c07fa486a9aa747e2e3185cb8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:45.967985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e186a9c07fa486a9aa747e2e3185cb8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:45.969924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:46.181403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e186a9c07fa486a9aa747e2e3185cb8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.182116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e186a9c07fa486a9aa747e2e3185cb8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.185671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e186a9c07fa486a9aa747e2e3185cb8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.195643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e186a9c07fa486a9aa747e2e3185cb8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.203492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4d048a14-5ac8-4f31-a5b3-fe0371c88b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e186a9c07fa486a9aa747e2e3185cb8'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.297705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1229/2430] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:20:45 2022] DELETE /identity/v3/users/3e186a9c07fa486a9aa747e2e3185cb8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:20:46.544946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:46.550210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:46.561731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9638120-f815-4369-9a40-2db753eec605 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:46.635767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:46.636753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:46.637036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:46.637311 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] PATH_INFO: `/v3/projects/11ad64bf66f149b5900180b8c8d7420f` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:46.638602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ad64bf66f149b5900180b8c8d7420f)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:46.640607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:46.748858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ad64bf66f149b5900180b8c8d7420f', 'request_id': 'req-0251bef9-a701-441c-9e08-8c48e268c581'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.754847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ad64bf66f149b5900180b8c8d7420f', 'request_id': 'req-0251bef9-a701-441c-9e08-8c48e268c581'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.760242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ad64bf66f149b5900180b8c8d7420f', 'request_id': 'req-0251bef9-a701-441c-9e08-8c48e268c581'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.846390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] The token cache is being invalidate because project 11ad64bf66f149b5900180b8c8d7420f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:20:46.846679 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.847309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:20:46.848860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1202/2431] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:20:46 2022] DELETE /identity/v3/projects/11ad64bf66f149b5900180b8c8d7420f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:20:53.181762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0deb92-1194-4d25-81c5-2e031f5808d7 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:53.182353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0deb92-1194-4d25-81c5-2e031f5808d7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:53.182353 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0deb92-1194-4d25-81c5-2e031f5808d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:53.200805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-0d0deb92-1194-4d25-81c5-2e031f5808d7 None None] MFA Rules not processed for user `d9e6e8acac7c447ba3885dcafb386050`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:20:53.202295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0d0deb92-1194-4d25-81c5-2e031f5808d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:53.255875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:53.257266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:53.262576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1230/2432] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:20:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:20:53.336842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251bef9-a701-441c-9e08-8c48e268c581 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:53.344184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6956876-1057-4719-b751-8b81a5086939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:53.345228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956876-1057-4719-b751-8b81a5086939 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:53.345559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956876-1057-4719-b751-8b81a5086939 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:53.345834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6956876-1057-4719-b751-8b81a5086939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:53.347861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e6956876-1057-4719-b751-8b81a5086939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:53.360407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6956876-1057-4719-b751-8b81a5086939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:53.363449 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6956876-1057-4719-b751-8b81a5086939 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:53.373889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1203/2433] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:20:53.573682 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0deb92-1194-4d25-81c5-2e031f5808d7 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:53.575222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0d0deb92-1194-4d25-81c5-2e031f5808d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:53.638263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0deb92-1194-4d25-81c5-2e031f5808d7 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:53.642818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:53.643598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:53.643882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:53.644156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:53.645971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:53.656402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:53.657842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:53.666462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1231/2434] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:20:54.281418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6956876-1057-4719-b751-8b81a5086939 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:20:54.293775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6956876-1057-4719-b751-8b81a5086939 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:20:54.299496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:20:54.300237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:20:54.300604 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:20:54.300942 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:20:54.302847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:20:54.315939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:20:54.317648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:20:54.328455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1204/2435] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:20:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:00.581352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:00.581352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:00.598405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a64d04-34a8-4c72-9a70-f246169bd5f3 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:00.606638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb3a9-efbe-482e-9b6f-9860c8909f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:00.607764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb3a9-efbe-482e-9b6f-9860c8909f1a service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:00.607764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb3a9-efbe-482e-9b6f-9860c8909f1a service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:00.607996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb3a9-efbe-482e-9b6f-9860c8909f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:00.609810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1effb3a9-efbe-482e-9b6f-9860c8909f1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:00.622217 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb3a9-efbe-482e-9b6f-9860c8909f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:00.623798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb3a9-efbe-482e-9b6f-9860c8909f1a service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:00.635631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1232/2436] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:21:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:02.438130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:02.439614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:02.451819 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112acfdc-75ba-4a57-9b66-baf03855cbfd service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:02.455650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:02.456304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:02.456588 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:02.456865 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:02.458704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:02.531364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:02.532730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:02.542547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1205/2437] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:03.978525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832e58d-4596-4959-9ed7-95b233025873 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:03.981308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832e58d-4596-4959-9ed7-95b233025873 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:03.981308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832e58d-4596-4959-9ed7-95b233025873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:03.998607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-1832e58d-4596-4959-9ed7-95b233025873 None None] MFA Rules not processed for user `44ffd5660baa40a7a3d6918cb5d31e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:04.000356 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1832e58d-4596-4959-9ed7-95b233025873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:04.071842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1233/2438] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:21:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:06.824704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:06.826189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:06.839670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991845ae-c8be-416b-b3e4-93928ea56c04 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:06.844485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:06.845356 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:06.845634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:06.845910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] PATH_INFO: `/v3/users/a14795cb97ac44b2a7fc1e2f79b12253` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:06.847177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14795cb97ac44b2a7fc1e2f79b12253)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:06.849090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.035594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14795cb97ac44b2a7fc1e2f79b12253'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.036325 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14795cb97ac44b2a7fc1e2f79b12253'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.049123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14795cb97ac44b2a7fc1e2f79b12253'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.049908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14795cb97ac44b2a7fc1e2f79b12253'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.056741 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c6fc373f-9de6-4318-9eba-dcee1f0e21ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14795cb97ac44b2a7fc1e2f79b12253'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.119383 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1206/2439] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:21:06 2022] DELETE /identity/v3/users/a14795cb97ac44b2a7fc1e2f79b12253 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:07.504322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832e58d-4596-4959-9ed7-95b233025873 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:07.517117 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832e58d-4596-4959-9ed7-95b233025873 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:07.584390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:07.585258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.585541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.585814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] PATH_INFO: `/v3/projects/316917d7a31645bfaac651f81154c18f` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.587043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316917d7a31645bfaac651f81154c18f)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:07.589114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:07.739583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316917d7a31645bfaac651f81154c18f', 'request_id': 'req-0b99f153-532d-4038-bf23-0edd28612444'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.881897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316917d7a31645bfaac651f81154c18f', 'request_id': 'req-0b99f153-532d-4038-bf23-0edd28612444'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.889332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316917d7a31645bfaac651f81154c18f', 'request_id': 'req-0b99f153-532d-4038-bf23-0edd28612444'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.903581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] The token cache is being invalidate because project 316917d7a31645bfaac651f81154c18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:21:07.903859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.904926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-0b99f153-532d-4038-bf23-0edd28612444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:21:07.906960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1234/2440] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:21:07 2022] DELETE /identity/v3/projects/316917d7a31645bfaac651f81154c18f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:07.912018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bef00d-56b2-4469-a966-746dcb67283b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.912538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bef00d-56b2-4469-a966-746dcb67283b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:07.912646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bef00d-56b2-4469-a966-746dcb67283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:07.930552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-68bef00d-56b2-4469-a966-746dcb67283b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:07.931828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-68bef00d-56b2-4469-a966-746dcb67283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:07.991032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1207/2441] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:07.999287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19a8c-f35f-4531-90ec-ec94000320e8 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:07.999918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19a8c-f35f-4531-90ec-ec94000320e8 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.000410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19a8c-f35f-4531-90ec-ec94000320e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.019223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8cb19a8c-f35f-4531-90ec-ec94000320e8 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:08.020496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8cb19a8c-f35f-4531-90ec-ec94000320e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:08.029442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1235/2442] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:21:08.033777 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bef00d-56b2-4469-a966-746dcb67283b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.043945 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bef00d-56b2-4469-a966-746dcb67283b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.048714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55981402-a552-4f0b-9eae-a0e9fd37280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.049405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55981402-a552-4f0b-9eae-a0e9fd37280f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.049688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55981402-a552-4f0b-9eae-a0e9fd37280f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.049957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55981402-a552-4f0b-9eae-a0e9fd37280f admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.050749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55981402-a552-4f0b-9eae-a0e9fd37280f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:21:08.051174 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55981402-a552-4f0b-9eae-a0e9fd37280f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.052775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55981402-a552-4f0b-9eae-a0e9fd37280f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.064724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1208/2443] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:21:08.069119 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb19a8c-f35f-4531-90ec-ec94000320e8 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.083776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb19a8c-f35f-4531-90ec-ec94000320e8 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.089472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94327e-830c-4539-bdb8-5bc1dec99c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.090992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94327e-830c-4539-bdb8-5bc1dec99c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.090992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94327e-830c-4539-bdb8-5bc1dec99c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.090992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94327e-830c-4539-bdb8-5bc1dec99c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.091475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94327e-830c-4539-bdb8-5bc1dec99c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.093386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94327e-830c-4539-bdb8-5bc1dec99c09 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.220459 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1236/2444] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:21:08.224746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55981402-a552-4f0b-9eae-a0e9fd37280f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.236012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55981402-a552-4f0b-9eae-a0e9fd37280f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.312308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dc6b9-4d12-4500-923d-f104b3abec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.312308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dc6b9-4d12-4500-923d-f104b3abec61 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.312308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dc6b9-4d12-4500-923d-f104b3abec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.312308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dc6b9-4d12-4500-923d-f104b3abec61 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.312745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dc6b9-4d12-4500-923d-f104b3abec61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.312745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dc6b9-4d12-4500-923d-f104b3abec61 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.404793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1209/2445] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:21:08 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:21:08.406010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94327e-830c-4539-bdb8-5bc1dec99c09 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.421260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94327e-830c-4539-bdb8-5bc1dec99c09 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.428193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea3908-427b-42fb-bbc9-d58416f33db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.433705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3908-427b-42fb-bbc9-d58416f33db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.433944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3908-427b-42fb-bbc9-d58416f33db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.434245 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3908-427b-42fb-bbc9-d58416f33db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.435066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea3908-427b-42fb-bbc9-d58416f33db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.436700 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea3908-427b-42fb-bbc9-d58416f33db2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.457975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1237/2446] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:21:08.461743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dc6b9-4d12-4500-923d-f104b3abec61 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.474606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dc6b9-4d12-4500-923d-f104b3abec61 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.480667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e174-6d52-477d-8416-d30964eb5c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.481367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e174-6d52-477d-8416-d30964eb5c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.481648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e174-6d52-477d-8416-d30964eb5c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.481947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e174-6d52-477d-8416-d30964eb5c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.482708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048e174-6d52-477d-8416-d30964eb5c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.484308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048e174-6d52-477d-8416-d30964eb5c33 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.496326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1210/2447] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:21:08.500064 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea3908-427b-42fb-bbc9-d58416f33db2 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.511078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea3908-427b-42fb-bbc9-d58416f33db2 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.517261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6d245-9b1a-40e2-9027-846bd190eb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.518204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6d245-9b1a-40e2-9027-846bd190eb4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.518518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6d245-9b1a-40e2-9027-846bd190eb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.518793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6d245-9b1a-40e2-9027-846bd190eb4d admin admin] PATH_INFO: `/v3/projects/440329d501de48d19ba51dceaa845197/users/c7788bd93c7649368e3fc926a969c7ed/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.537924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6d245-9b1a-40e2-9027-846bd190eb4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=440329d501de48d19ba51dceaa845197, user_id=c7788bd93c7649368e3fc926a969c7ed, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.540739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6d245-9b1a-40e2-9027-846bd190eb4d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.619388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1238/2448] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:21:08 2022] PUT /identity/v3/projects/440329d501de48d19ba51dceaa845197/users/c7788bd93c7649368e3fc926a969c7ed/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:21:08.625246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42d24b-e7a3-4066-921e-46a6cc88621b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.625568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42d24b-e7a3-4066-921e-46a6cc88621b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.625849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42d24b-e7a3-4066-921e-46a6cc88621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.643801 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cd42d24b-e7a3-4066-921e-46a6cc88621b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:08.645020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cd42d24b-e7a3-4066-921e-46a6cc88621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:08.700716 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1211/2449] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:08.710014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6d245-9b1a-40e2-9027-846bd190eb4d admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:08.711673 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b1f6d245-9b1a-40e2-9027-846bd190eb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:08.768034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6d245-9b1a-40e2-9027-846bd190eb4d admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:08.771745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37b3f5-9832-41e7-a7c7-bc0a93f95910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:08.772461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37b3f5-9832-41e7-a7c7-bc0a93f95910 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:08.772733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37b3f5-9832-41e7-a7c7-bc0a93f95910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:08.773001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37b3f5-9832-41e7-a7c7-bc0a93f95910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:08.783011 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37b3f5-9832-41e7-a7c7-bc0a93f95910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:08.784482 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37b3f5-9832-41e7-a7c7-bc0a93f95910 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:08.794690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1239/2450] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:14.532122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f3fc-f40b-438c-bcc9-dc615f64e5dd None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:14.532659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f3fc-f40b-438c-bcc9-dc615f64e5dd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:14.532659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236f3fc-f40b-438c-bcc9-dc615f64e5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:14.563815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0236f3fc-f40b-438c-bcc9-dc615f64e5dd None None] MFA Rules not processed for user `c7788bd93c7649368e3fc926a969c7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:14.563815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0236f3fc-f40b-438c-bcc9-dc615f64e5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:14.629704 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1212/2451] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:21:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:14.644899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37b3f5-9832-41e7-a7c7-bc0a93f95910 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:21:14.646528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bb37b3f5-9832-41e7-a7c7-bc0a93f95910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:14.722745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37b3f5-9832-41e7-a7c7-bc0a93f95910 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:21:14.728297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf96cc-7bcb-4028-9c16-a449f1a975a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:21:14.728967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf96cc-7bcb-4028-9c16-a449f1a975a1 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:14.729251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf96cc-7bcb-4028-9c16-a449f1a975a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:14.729527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf96cc-7bcb-4028-9c16-a449f1a975a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:14.738842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf96cc-7bcb-4028-9c16-a449f1a975a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:21:14.740656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf96cc-7bcb-4028-9c16-a449f1a975a1 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:21:14.750429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1240/2452] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:21:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:21:17.811645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5351e-eaa0-456c-8ee7-8545cb2cd466 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:17.813123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5351e-eaa0-456c-8ee7-8545cb2cd466 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:17.813633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5351e-eaa0-456c-8ee7-8545cb2cd466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:17.837724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e7e5351e-eaa0-456c-8ee7-8545cb2cd466 None None] MFA Rules not processed for user `c7788bd93c7649368e3fc926a969c7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:17.839671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e7e5351e-eaa0-456c-8ee7-8545cb2cd466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:17.849776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1213/2453] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:21:19.210941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b95797-e850-41dc-9083-07ce9a7b2d3b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:21:19.211846 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b95797-e850-41dc-9083-07ce9a7b2d3b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:21:19.212297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b95797-e850-41dc-9083-07ce9a7b2d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:21:19.232189 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-53b95797-e850-41dc-9083-07ce9a7b2d3b None None] MFA Rules not processed for user `b34f24054c204d7cb69ca41099913ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:21:19.233397 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-53b95797-e850-41dc-9083-07ce9a7b2d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:21:19.311996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1241/2454] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:06.662594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5351e-eaa0-456c-8ee7-8545cb2cd466 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:06.664629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e7e5351e-eaa0-456c-8ee7-8545cb2cd466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:06.680007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5351e-eaa0-456c-8ee7-8545cb2cd466 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:06.686441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:06.686441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:06.686441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:06.686441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] PATH_INFO: `/v3/users/d9e6e8acac7c447ba3885dcafb386050` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:06.687607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e6e8acac7c447ba3885dcafb386050)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:06.689556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:06.892132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e6e8acac7c447ba3885dcafb386050'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:06.892787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e6e8acac7c447ba3885dcafb386050'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:06.904614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e6e8acac7c447ba3885dcafb386050'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:06.905234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e6e8acac7c447ba3885dcafb386050'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:06.911845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e6e8acac7c447ba3885dcafb386050'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:07.003873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1214/2455] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:06 2022] DELETE /identity/v3/users/d9e6e8acac7c447ba3885dcafb386050 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:07.239992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b95797-e850-41dc-9083-07ce9a7b2d3b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:07.251166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b95797-e850-41dc-9083-07ce9a7b2d3b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:07.314384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:07.315162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:07.315439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:07.315734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] PATH_INFO: `/v3/projects/f6ec3267b0c548558b92318ec6179dca` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:07.316924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ec3267b0c548558b92318ec6179dca)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:07.318918 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:07.415042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ec3267b0c548558b92318ec6179dca', 'request_id': 'req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:07.467521 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ec3267b0c548558b92318ec6179dca', 'request_id': 'req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:07.473503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ec3267b0c548558b92318ec6179dca', 'request_id': 'req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:07.484991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] The token cache is being invalidate because project f6ec3267b0c548558b92318ec6179dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:07.485271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:07.485882 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:07.487440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1242/2456] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:07 2022] DELETE /identity/v3/projects/f6ec3267b0c548558b92318ec6179dca => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:29.022450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:29.024251 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:29.093309 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67cdbb-eef7-41fe-8e1d-0ddce1fe035a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:29.146745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:29.147392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:29.147671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:29.148091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:29.149705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:29.211555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:29.213079 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:29.222709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1215/2457] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:30.384088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:30.388541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:30.401505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c82b6e-94d9-4986-b09b-004fb8fe3f3c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:30.405075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1f7c0-729f-4555-bf13-74711ec73a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:30.405859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1f7c0-729f-4555-bf13-74711ec73a78 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:30.405974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1f7c0-729f-4555-bf13-74711ec73a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:30.406283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1f7c0-729f-4555-bf13-74711ec73a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:30.408079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c5b1f7c0-729f-4555-bf13-74711ec73a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:30.421421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1f7c0-729f-4555-bf13-74711ec73a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:30.423167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1f7c0-729f-4555-bf13-74711ec73a78 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:30.435663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1243/2458] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:33.199359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.200962 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:33.222507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb53261-9823-4665-9458-58b1f62c7a88 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:33.228874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:33.229751 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:33.230032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:33.230593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] PATH_INFO: `/v3/users/44ffd5660baa40a7a3d6918cb5d31e56` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:33.232080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ffd5660baa40a7a3d6918cb5d31e56)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:33.233865 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:33.453616 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ffd5660baa40a7a3d6918cb5d31e56'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:33.454298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ffd5660baa40a7a3d6918cb5d31e56'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:33.465726 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ffd5660baa40a7a3d6918cb5d31e56'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:33.466422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ffd5660baa40a7a3d6918cb5d31e56'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:33.473092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0322a789-288c-429c-bec7-a56ec4bdae99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ffd5660baa40a7a3d6918cb5d31e56'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:33.549073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1216/2459] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:33 2022] DELETE /identity/v3/users/44ffd5660baa40a7a3d6918cb5d31e56 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:33.945108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1f7c0-729f-4555-bf13-74711ec73a78 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:33.958387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1f7c0-729f-4555-bf13-74711ec73a78 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:34.044723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:34.047056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.047767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.048461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] PATH_INFO: `/v3/projects/d143bc5a616249a7beefc7b27962026b` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.049914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d143bc5a616249a7beefc7b27962026b)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:34.053649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:34.188512 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd143bc5a616249a7beefc7b27962026b', 'request_id': 'req-8a2ebcdb-aede-449d-a8a1-8158b798da0f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.265981 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd143bc5a616249a7beefc7b27962026b', 'request_id': 'req-8a2ebcdb-aede-449d-a8a1-8158b798da0f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.273428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd143bc5a616249a7beefc7b27962026b', 'request_id': 'req-8a2ebcdb-aede-449d-a8a1-8158b798da0f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.286820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] The token cache is being invalidate because project d143bc5a616249a7beefc7b27962026b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:34.287676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.288445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8a2ebcdb-aede-449d-a8a1-8158b798da0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.294410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1244/2460] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:33 2022] DELETE /identity/v3/projects/d143bc5a616249a7beefc7b27962026b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:34.296242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43183c-69e6-44d3-ba33-75fd2c267554 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.296794 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43183c-69e6-44d3-ba33-75fd2c267554 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.296998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43183c-69e6-44d3-ba33-75fd2c267554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.316434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4e43183c-69e6-44d3-ba33-75fd2c267554 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:34.317872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4e43183c-69e6-44d3-ba33-75fd2c267554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:34.386780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1217/2461] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:34.388809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0811-5c93-4b4e-bec9-a516e0349d9b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.389305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0811-5c93-4b4e-bec9-a516e0349d9b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.389716 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0811-5c93-4b4e-bec9-a516e0349d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.409946 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-651e0811-5c93-4b4e-bec9-a516e0349d9b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:34.411267 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-651e0811-5c93-4b4e-bec9-a516e0349d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:34.419894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1245/2462] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:34.423655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43183c-69e6-44d3-ba33-75fd2c267554 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:34.433791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43183c-69e6-44d3-ba33-75fd2c267554 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:34.439093 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396b4c5-63cb-4f30-b75d-e6d8123a5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:34.439840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396b4c5-63cb-4f30-b75d-e6d8123a5689 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.440205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396b4c5-63cb-4f30-b75d-e6d8123a5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.440537 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396b4c5-63cb-4f30-b75d-e6d8123a5689 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.441334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396b4c5-63cb-4f30-b75d-e6d8123a5689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:34.441708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396b4c5-63cb-4f30-b75d-e6d8123a5689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:34.444000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396b4c5-63cb-4f30-b75d-e6d8123a5689 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:34.457061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1218/2463] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:22:34.462042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0811-5c93-4b4e-bec9-a516e0349d9b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:34.471762 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0811-5c93-4b4e-bec9-a516e0349d9b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:34.477779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126e7df-1040-4d3f-9fb6-e6d642c0fd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:34.478814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126e7df-1040-4d3f-9fb6-e6d642c0fd01 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.479179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126e7df-1040-4d3f-9fb6-e6d642c0fd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.479655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126e7df-1040-4d3f-9fb6-e6d642c0fd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.480541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126e7df-1040-4d3f-9fb6-e6d642c0fd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:34.482783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126e7df-1040-4d3f-9fb6-e6d642c0fd01 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:34.561790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1246/2464] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:34 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:34.564572 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396b4c5-63cb-4f30-b75d-e6d8123a5689 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:34.574789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396b4c5-63cb-4f30-b75d-e6d8123a5689 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:34.629620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da389-c208-4c92-be37-d1644f44e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:34.630873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1da389-c208-4c92-be37-d1644f44e50f admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.631158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1da389-c208-4c92-be37-d1644f44e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.631433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1da389-c208-4c92-be37-d1644f44e50f admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.632109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1da389-c208-4c92-be37-d1644f44e50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:34.634023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1da389-c208-4c92-be37-d1644f44e50f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:34.711768 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126e7df-1040-4d3f-9fb6-e6d642c0fd01 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:34.713517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e126e7df-1040-4d3f-9fb6-e6d642c0fd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:34.726228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126e7df-1040-4d3f-9fb6-e6d642c0fd01 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:34.731190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:34.732049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.737734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.737734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] PATH_INFO: `/v3/users/911ef817a1ee4790ad97e857a299fb01` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.737734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=911ef817a1ee4790ad97e857a299fb01)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:34.738028 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1219/2465] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:34 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:34.738152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:34.741198 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da389-c208-4c92-be37-d1644f44e50f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:34.750875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da389-c208-4c92-be37-d1644f44e50f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:34.756374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cae98-4de9-49b5-a1aa-bbd97a74841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:34.757147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cae98-4de9-49b5-a1aa-bbd97a74841d admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.757433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cae98-4de9-49b5-a1aa-bbd97a74841d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.757730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cae98-4de9-49b5-a1aa-bbd97a74841d admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.758645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cae98-4de9-49b5-a1aa-bbd97a74841d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:34.760228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cae98-4de9-49b5-a1aa-bbd97a74841d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:34.770482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1220/2466] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:34.774358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cae98-4de9-49b5-a1aa-bbd97a74841d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:34.783562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cae98-4de9-49b5-a1aa-bbd97a74841d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:34.788104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56450ea4-bcfa-4879-b486-3336540b0453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:34.788713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56450ea4-bcfa-4879-b486-3336540b0453 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.789041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56450ea4-bcfa-4879-b486-3336540b0453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.789314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56450ea4-bcfa-4879-b486-3336540b0453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.790000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56450ea4-bcfa-4879-b486-3336540b0453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:34.791568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56450ea4-bcfa-4879-b486-3336540b0453 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:34.802630 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1221/2467] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:34.806348 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56450ea4-bcfa-4879-b486-3336540b0453 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:34.815241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56450ea4-bcfa-4879-b486-3336540b0453 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:34.820412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3192fa-4607-4b0b-9404-ecdaa5c05914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:34.821240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3192fa-4607-4b0b-9404-ecdaa5c05914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.821515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3192fa-4607-4b0b-9404-ecdaa5c05914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.821829 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3192fa-4607-4b0b-9404-ecdaa5c05914 admin admin] PATH_INFO: `/v3/projects/ce8ac7d37393427bb90ecf64c05ebf84/users/a58ab314b90a45fcb0cd6b1fac1d1a45/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.836455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3192fa-4607-4b0b-9404-ecdaa5c05914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8ac7d37393427bb90ecf64c05ebf84, user_id=a58ab314b90a45fcb0cd6b1fac1d1a45, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:34.839165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3192fa-4607-4b0b-9404-ecdaa5c05914 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:34.889850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911ef817a1ee4790ad97e857a299fb01'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.890546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911ef817a1ee4790ad97e857a299fb01'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.891148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911ef817a1ee4790ad97e857a299fb01'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.902422 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911ef817a1ee4790ad97e857a299fb01'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.908899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911ef817a1ee4790ad97e857a299fb01'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:34.939136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1222/2468] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:34 2022] PUT /identity/v3/projects/ce8ac7d37393427bb90ecf64c05ebf84/users/a58ab314b90a45fcb0cd6b1fac1d1a45/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:34.949211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5491cec-f4cb-4cd0-8e92-72936c483b43 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:34.949492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5491cec-f4cb-4cd0-8e92-72936c483b43 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:34.949760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5491cec-f4cb-4cd0-8e92-72936c483b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:34.975110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c5491cec-f4cb-4cd0-8e92-72936c483b43 None None] MFA Rules not processed for user `a58ab314b90a45fcb0cd6b1fac1d1a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:34.976281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c5491cec-f4cb-4cd0-8e92-72936c483b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.008055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1247/2469] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:34 2022] DELETE /identity/v3/users/911ef817a1ee4790ad97e857a299fb01 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:35.039308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1223/2470] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:35.050490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:35.053049 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.130931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25c9a8-4bfb-43b4-aed6-a0986bb8f3b7 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:35.136444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93537a-21e8-40c8-987f-ed6d741fa7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:35.137133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93537a-21e8-40c8-987f-ed6d741fa7df service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.137421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93537a-21e8-40c8-987f-ed6d741fa7df service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.137693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93537a-21e8-40c8-987f-ed6d741fa7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.197380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93537a-21e8-40c8-987f-ed6d741fa7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:35.199032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93537a-21e8-40c8-987f-ed6d741fa7df service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:35.207948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1248/2471] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:35.266747 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5491cec-f4cb-4cd0-8e92-72936c483b43 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:35.267736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c5491cec-f4cb-4cd0-8e92-72936c483b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.357050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5491cec-f4cb-4cd0-8e92-72936c483b43 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:35.421732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:35.421732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.421957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.422261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] PATH_INFO: `/v3/projects/9703f082240542aa979c6b53052d77b9` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.423437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9703f082240542aa979c6b53052d77b9)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:35.425432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:35.426157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93537a-21e8-40c8-987f-ed6d741fa7df service nova] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:35.427560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8c93537a-21e8-40c8-987f-ed6d741fa7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.440636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93537a-21e8-40c8-987f-ed6d741fa7df service nova] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:35.445127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:35.445972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.446282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.446554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] PATH_INFO: `/v3/users/a58ab314b90a45fcb0cd6b1fac1d1a45` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.447732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58ab314b90a45fcb0cd6b1fac1d1a45)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:35.449641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:35.526166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9703f082240542aa979c6b53052d77b9', 'request_id': 'req-d04707f9-3cab-4f37-90a7-3416ef7042d7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.532380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9703f082240542aa979c6b53052d77b9', 'request_id': 'req-d04707f9-3cab-4f37-90a7-3416ef7042d7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.538357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9703f082240542aa979c6b53052d77b9', 'request_id': 'req-d04707f9-3cab-4f37-90a7-3416ef7042d7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.618679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58ab314b90a45fcb0cd6b1fac1d1a45'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.619253 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58ab314b90a45fcb0cd6b1fac1d1a45'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.619841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58ab314b90a45fcb0cd6b1fac1d1a45'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.630891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58ab314b90a45fcb0cd6b1fac1d1a45'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.637470 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-346154e6-4f04-4b2b-a918-a9f431b3550d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58ab314b90a45fcb0cd6b1fac1d1a45'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.673645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] The token cache is being invalidate because project 9703f082240542aa979c6b53052d77b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:35.673927 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.674568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d04707f9-3cab-4f37-90a7-3416ef7042d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:35.676124 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1224/2472] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:35 2022] DELETE /identity/v3/projects/9703f082240542aa979c6b53052d77b9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:35.680845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064aeb9-9ad0-4b30-b2c5-ccc05fd791e2 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.681129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064aeb9-9ad0-4b30-b2c5-ccc05fd791e2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.681404 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064aeb9-9ad0-4b30-b2c5-ccc05fd791e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.698936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b064aeb9-9ad0-4b30-b2c5-ccc05fd791e2 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:35.700110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b064aeb9-9ad0-4b30-b2c5-ccc05fd791e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.760977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1225/2473] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:35.768858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199a1a-0dd2-4fed-9942-693a8ec3e4e1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.769643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199a1a-0dd2-4fed-9942-693a8ec3e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.769920 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199a1a-0dd2-4fed-9942-693a8ec3e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.778087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1249/2474] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:35 2022] DELETE /identity/v3/users/a58ab314b90a45fcb0cd6b1fac1d1a45 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:35.786447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb34dc4-ff77-4d6b-a19a-659d747d8acd None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.786447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb34dc4-ff77-4d6b-a19a-659d747d8acd None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.786447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb34dc4-ff77-4d6b-a19a-659d747d8acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.789922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ee199a1a-0dd2-4fed-9942-693a8ec3e4e1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:35.791158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ee199a1a-0dd2-4fed-9942-693a8ec3e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.800331 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-0cb34dc4-ff77-4d6b-a19a-659d747d8acd None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:35.801581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0cb34dc4-ff77-4d6b-a19a-659d747d8acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.848712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1226/2475] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:35.852840 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee199a1a-0dd2-4fed-9942-693a8ec3e4e1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:35.858473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1250/2476] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:35.862252 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee199a1a-0dd2-4fed-9942-693a8ec3e4e1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:35.867019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b42c2-2f30-4223-ba25-3f33ecf79ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:35.867672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b42c2-2f30-4223-ba25-3f33ecf79ded admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.867831 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb34dc4-ff77-4d6b-a19a-659d747d8acd None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:35.868163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b42c2-2f30-4223-ba25-3f33ecf79ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.868555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b42c2-2f30-4223-ba25-3f33ecf79ded admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.869271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0cb34dc4-ff77-4d6b-a19a-659d747d8acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:35.869385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b42c2-2f30-4223-ba25-3f33ecf79ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:35.869576 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b42c2-2f30-4223-ba25-3f33ecf79ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:35.871204 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b42c2-2f30-4223-ba25-3f33ecf79ded admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:35.883316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1227/2477] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:22:35.888262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b42c2-2f30-4223-ba25-3f33ecf79ded admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:35.898210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b42c2-2f30-4223-ba25-3f33ecf79ded admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:35.902928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f0e3b-95bb-4ae2-8c91-29760c41ef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:35.903553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f0e3b-95bb-4ae2-8c91-29760c41ef8e admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.903837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f0e3b-95bb-4ae2-8c91-29760c41ef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.904112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f0e3b-95bb-4ae2-8c91-29760c41ef8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.904787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f0e3b-95bb-4ae2-8c91-29760c41ef8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:35.906812 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f0e3b-95bb-4ae2-8c91-29760c41ef8e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:35.923613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb34dc4-ff77-4d6b-a19a-659d747d8acd None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:35.927261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cffd2-23b1-449e-ad39-d86d6d005f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:35.927890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cffd2-23b1-449e-ad39-d86d6d005f1d service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:35.928174 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cffd2-23b1-449e-ad39-d86d6d005f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:35.934653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cffd2-23b1-449e-ad39-d86d6d005f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:35.937169 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cffd2-23b1-449e-ad39-d86d6d005f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:35.938621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cffd2-23b1-449e-ad39-d86d6d005f1d service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:35.948266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1251/2478] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:22:36.058916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1228/2479] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:35 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:36.062958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cffd2-23b1-449e-ad39-d86d6d005f1d service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.073029 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cffd2-23b1-449e-ad39-d86d6d005f1d service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.129233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327ba2d-73ef-4af0-bfbe-4af1de95f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.129840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327ba2d-73ef-4af0-bfbe-4af1de95f3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.130201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327ba2d-73ef-4af0-bfbe-4af1de95f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.130480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327ba2d-73ef-4af0-bfbe-4af1de95f3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.131180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327ba2d-73ef-4af0-bfbe-4af1de95f3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.133142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327ba2d-73ef-4af0-bfbe-4af1de95f3a1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.229053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1252/2480] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:36 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:36.232709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f0e3b-95bb-4ae2-8c91-29760c41ef8e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.244336 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f0e3b-95bb-4ae2-8c91-29760c41ef8e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.249337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71636700-54bb-473e-9165-5bc82b3dc774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.251880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71636700-54bb-473e-9165-5bc82b3dc774 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.251880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71636700-54bb-473e-9165-5bc82b3dc774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.251880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71636700-54bb-473e-9165-5bc82b3dc774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.251880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71636700-54bb-473e-9165-5bc82b3dc774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.253580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71636700-54bb-473e-9165-5bc82b3dc774 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.264148 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1229/2481] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:36.268091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327ba2d-73ef-4af0-bfbe-4af1de95f3a1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.278480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327ba2d-73ef-4af0-bfbe-4af1de95f3a1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.283163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bcc9e-c0f7-4771-83d7-5e2929de5e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.283847 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bcc9e-c0f7-4771-83d7-5e2929de5e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.284265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bcc9e-c0f7-4771-83d7-5e2929de5e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.284571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bcc9e-c0f7-4771-83d7-5e2929de5e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.285295 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bcc9e-c0f7-4771-83d7-5e2929de5e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.286926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bcc9e-c0f7-4771-83d7-5e2929de5e28 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.296772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1253/2482] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:36.301399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71636700-54bb-473e-9165-5bc82b3dc774 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.311185 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71636700-54bb-473e-9165-5bc82b3dc774 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.316585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24fe07-dbdc-4577-b33b-b72aabe76276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.317545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24fe07-dbdc-4577-b33b-b72aabe76276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.317828 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24fe07-dbdc-4577-b33b-b72aabe76276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.318137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24fe07-dbdc-4577-b33b-b72aabe76276 admin admin] PATH_INFO: `/v3/projects/949b520db373441b9aa0191b5e4e7243/users/8d82dd2687524ef1bb8d56bf4da5f121/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.332437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24fe07-dbdc-4577-b33b-b72aabe76276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949b520db373441b9aa0191b5e4e7243, user_id=8d82dd2687524ef1bb8d56bf4da5f121, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.335285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24fe07-dbdc-4577-b33b-b72aabe76276 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.361293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bcc9e-c0f7-4771-83d7-5e2929de5e28 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.363747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3f1bcc9e-c0f7-4771-83d7-5e2929de5e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.379421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bcc9e-c0f7-4771-83d7-5e2929de5e28 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.384294 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.385648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.385973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.386406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] PATH_INFO: `/v3/projects/ce8ac7d37393427bb90ecf64c05ebf84` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.387808 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8ac7d37393427bb90ecf64c05ebf84)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.389690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.439858 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1230/2483] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:36 2022] PUT /identity/v3/projects/949b520db373441b9aa0191b5e4e7243/users/8d82dd2687524ef1bb8d56bf4da5f121/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:36.450481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae908fc-d5a9-4a83-b68c-7f55c9cf68b9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.450769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae908fc-d5a9-4a83-b68c-7f55c9cf68b9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.451048 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae908fc-d5a9-4a83-b68c-7f55c9cf68b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.477308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9ae908fc-d5a9-4a83-b68c-7f55c9cf68b9 None None] MFA Rules not processed for user `8d82dd2687524ef1bb8d56bf4da5f121`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:36.478563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9ae908fc-d5a9-4a83-b68c-7f55c9cf68b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.547936 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8ac7d37393427bb90ecf64c05ebf84', 'request_id': 'req-2a23c1c2-5485-4507-8d15-7870f134c4df'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.550404 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1231/2484] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:36.554733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae908fc-d5a9-4a83-b68c-7f55c9cf68b9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.604518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8ac7d37393427bb90ecf64c05ebf84', 'request_id': 'req-2a23c1c2-5485-4507-8d15-7870f134c4df'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.610891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8ac7d37393427bb90ecf64c05ebf84', 'request_id': 'req-2a23c1c2-5485-4507-8d15-7870f134c4df'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.615511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae908fc-d5a9-4a83-b68c-7f55c9cf68b9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.622835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] The token cache is being invalidate because project ce8ac7d37393427bb90ecf64c05ebf84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:36.623128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.623776 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-2a23c1c2-5485-4507-8d15-7870f134c4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:36.625323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1254/2485] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:36 2022] DELETE /identity/v3/projects/ce8ac7d37393427bb90ecf64c05ebf84 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:36.629991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65624c34-dbed-4a69-90f8-c933e23efdcf None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.630251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65624c34-dbed-4a69-90f8-c933e23efdcf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.630532 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65624c34-dbed-4a69-90f8-c933e23efdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.647391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-65624c34-dbed-4a69-90f8-c933e23efdcf None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:36.648636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-65624c34-dbed-4a69-90f8-c933e23efdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.671578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c1b68-f8fd-4ea8-bc14-3434fbef30a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.672243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c1b68-f8fd-4ea8-bc14-3434fbef30a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.672526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c1b68-f8fd-4ea8-bc14-3434fbef30a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.672803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c1b68-f8fd-4ea8-bc14-3434fbef30a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.673528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c1b68-f8fd-4ea8-bc14-3434fbef30a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.676233 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c1b68-f8fd-4ea8-bc14-3434fbef30a8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.708657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1255/2486] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:36.717449 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de358-6e16-4d49-8db5-0b0d22fce48f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.717724 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de358-6e16-4d49-8db5-0b0d22fce48f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.718002 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de358-6e16-4d49-8db5-0b0d22fce48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.736951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c20de358-6e16-4d49-8db5-0b0d22fce48f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:36.738195 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c20de358-6e16-4d49-8db5-0b0d22fce48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.746493 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1256/2487] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:36.753343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1232/2488] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:36 2022] POST /identity/v3/projects => generated 371 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:36.753475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20de358-6e16-4d49-8db5-0b0d22fce48f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.753733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c1b68-f8fd-4ea8-bc14-3434fbef30a8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.754361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c20de358-6e16-4d49-8db5-0b0d22fce48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:36.766401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20de358-6e16-4d49-8db5-0b0d22fce48f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.815564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c1b68-f8fd-4ea8-bc14-3434fbef30a8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.820216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706ce3-0bb1-4620-9227-da4471f29631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.820926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706ce3-0bb1-4620-9227-da4471f29631 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.821129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47223110-4d10-498e-9c41-4db41154d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.821249 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706ce3-0bb1-4620-9227-da4471f29631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.821458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706ce3-0bb1-4620-9227-da4471f29631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.821790 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47223110-4d10-498e-9c41-4db41154d309 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.822098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47223110-4d10-498e-9c41-4db41154d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.822230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50706ce3-0bb1-4620-9227-da4471f29631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:36.822372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47223110-4d10-498e-9c41-4db41154d309 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.822494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50706ce3-0bb1-4620-9227-da4471f29631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.823054 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47223110-4d10-498e-9c41-4db41154d309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.824074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50706ce3-0bb1-4620-9227-da4471f29631 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.824950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47223110-4d10-498e-9c41-4db41154d309 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.835641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1233/2489] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:22:36.839827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706ce3-0bb1-4620-9227-da4471f29631 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.849551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706ce3-0bb1-4620-9227-da4471f29631 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.854032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7161421-0b11-44b8-9275-692d04ab32b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.854662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7161421-0b11-44b8-9275-692d04ab32b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.854937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7161421-0b11-44b8-9275-692d04ab32b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.855206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7161421-0b11-44b8-9275-692d04ab32b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.855864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7161421-0b11-44b8-9275-692d04ab32b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.857969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7161421-0b11-44b8-9275-692d04ab32b4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.908159 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1257/2490] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:36 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:36.911784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47223110-4d10-498e-9c41-4db41154d309 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.921208 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47223110-4d10-498e-9c41-4db41154d309 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:36.926000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077629d-9abb-431c-a20f-b839745ec147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:36.926676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077629d-9abb-431c-a20f-b839745ec147 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:36.926959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077629d-9abb-431c-a20f-b839745ec147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:36.927233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077629d-9abb-431c-a20f-b839745ec147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:36.927951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077629d-9abb-431c-a20f-b839745ec147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:36.929568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077629d-9abb-431c-a20f-b839745ec147 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:36.932289 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1234/2491] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:36 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:36.942660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1258/2492] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:36.942815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7161421-0b11-44b8-9275-692d04ab32b4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.943600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077629d-9abb-431c-a20f-b839745ec147 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:36.952931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077629d-9abb-431c-a20f-b839745ec147 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.001675 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7161421-0b11-44b8-9275-692d04ab32b4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.006877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad0c32-399f-4770-bf69-a0d0cd0fba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.007659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad0c32-399f-4770-bf69-a0d0cd0fba71 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.007944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad0c32-399f-4770-bf69-a0d0cd0fba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.008356 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad0c32-399f-4770-bf69-a0d0cd0fba71 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.008958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad0c32-399f-4770-bf69-a0d0cd0fba71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.011068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad0c32-399f-4770-bf69-a0d0cd0fba71 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.011723 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e7742-fd0e-4e1e-8ec5-2a2f93c016a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.012600 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e7742-fd0e-4e1e-8ec5-2a2f93c016a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.012876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e7742-fd0e-4e1e-8ec5-2a2f93c016a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.013142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e7742-fd0e-4e1e-8ec5-2a2f93c016a3 admin admin] PATH_INFO: `/v3/projects/1fff3bbe12c246c1bb58ed41e2db28a6/users/a89dc8c9a7ca4a95bedf7831e23431c0/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.028054 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e7742-fd0e-4e1e-8ec5-2a2f93c016a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fff3bbe12c246c1bb58ed41e2db28a6, user_id=a89dc8c9a7ca4a95bedf7831e23431c0, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.030905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e7742-fd0e-4e1e-8ec5-2a2f93c016a3 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.084223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1235/2493] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:36 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:37.088254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad0c32-399f-4770-bf69-a0d0cd0fba71 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.098010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad0c32-399f-4770-bf69-a0d0cd0fba71 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.102649 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556e619-b132-4de5-97fb-20ef49d48c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.103277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556e619-b132-4de5-97fb-20ef49d48c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.103556 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556e619-b132-4de5-97fb-20ef49d48c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.103825 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556e619-b132-4de5-97fb-20ef49d48c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.104534 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556e619-b132-4de5-97fb-20ef49d48c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.106197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556e619-b132-4de5-97fb-20ef49d48c5a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.107378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1259/2494] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:36 2022] PUT /identity/v3/projects/1fff3bbe12c246c1bb58ed41e2db28a6/users/a89dc8c9a7ca4a95bedf7831e23431c0/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:37.111448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e7742-fd0e-4e1e-8ec5-2a2f93c016a3 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.119177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1236/2495] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:37.120165 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556e619-b132-4de5-97fb-20ef49d48c5a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.129269 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556e619-b132-4de5-97fb-20ef49d48c5a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.172081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e7742-fd0e-4e1e-8ec5-2a2f93c016a3 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.176722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cc7c5-bf65-434d-9011-2bbf53b3b357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.177379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cc7c5-bf65-434d-9011-2bbf53b3b357 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.177659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cc7c5-bf65-434d-9011-2bbf53b3b357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.177933 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cc7c5-bf65-434d-9011-2bbf53b3b357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.178689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cc7c5-bf65-434d-9011-2bbf53b3b357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.180329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cc7c5-bf65-434d-9011-2bbf53b3b357 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.185656 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ad71b-13f0-4733-9630-7a7543061aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.186366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ad71b-13f0-4733-9630-7a7543061aca admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.186651 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ad71b-13f0-4733-9630-7a7543061aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.186934 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ad71b-13f0-4733-9630-7a7543061aca admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.187654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ad71b-13f0-4733-9630-7a7543061aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.189784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ad71b-13f0-4733-9630-7a7543061aca admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.190732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1260/2496] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:37.194748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cc7c5-bf65-434d-9011-2bbf53b3b357 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.199596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1237/2497] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:37.203612 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ad71b-13f0-4733-9630-7a7543061aca admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.204677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cc7c5-bf65-434d-9011-2bbf53b3b357 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.209371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4349da-06e8-4e91-9907-dec5d7f113d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.210261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4349da-06e8-4e91-9907-dec5d7f113d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.210539 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4349da-06e8-4e91-9907-dec5d7f113d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.210811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4349da-06e8-4e91-9907-dec5d7f113d7 admin admin] PATH_INFO: `/v3/projects/1fff3bbe12c246c1bb58ed41e2db28a6/users/a89dc8c9a7ca4a95bedf7831e23431c0/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.213010 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4349da-06e8-4e91-9907-dec5d7f113d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fff3bbe12c246c1bb58ed41e2db28a6, user_id=a89dc8c9a7ca4a95bedf7831e23431c0, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.213789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ad71b-13f0-4733-9630-7a7543061aca admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.215713 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4349da-06e8-4e91-9907-dec5d7f113d7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.218570 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760795b-f852-42fd-b50a-e7a225b29817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.219451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760795b-f852-42fd-b50a-e7a225b29817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.219712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760795b-f852-42fd-b50a-e7a225b29817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.219990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760795b-f852-42fd-b50a-e7a225b29817 admin admin] PATH_INFO: `/v3/projects/6238103aa4ea4f4998d0ea9ab0d175cf/users/79d8c14781214d89880a896cab3e35fc/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.225950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1261/2498] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:37 2022] PUT /identity/v3/projects/1fff3bbe12c246c1bb58ed41e2db28a6/users/a89dc8c9a7ca4a95bedf7831e23431c0/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:37.238401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9837-b865-4d66-aa79-7b19fd0afa4c None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.238718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9837-b865-4d66-aa79-7b19fd0afa4c None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.238879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760795b-f852-42fd-b50a-e7a225b29817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6238103aa4ea4f4998d0ea9ab0d175cf, user_id=79d8c14781214d89880a896cab3e35fc, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.238984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9837-b865-4d66-aa79-7b19fd0afa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.241455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760795b-f852-42fd-b50a-e7a225b29817 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.267357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-573f9837-b865-4d66-aa79-7b19fd0afa4c None None] MFA Rules not processed for user `a89dc8c9a7ca4a95bedf7831e23431c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:37.268557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-573f9837-b865-4d66-aa79-7b19fd0afa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:37.332502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1262/2499] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:37.341149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1238/2500] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:37 2022] PUT /identity/v3/projects/6238103aa4ea4f4998d0ea9ab0d175cf/users/79d8c14781214d89880a896cab3e35fc/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:37.344092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9837-b865-4d66-aa79-7b19fd0afa4c None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.345477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-573f9837-b865-4d66-aa79-7b19fd0afa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:37.351500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1b06a-139f-4c29-9307-f4faf2983676 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.355682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1b06a-139f-4c29-9307-f4faf2983676 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.355682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1b06a-139f-4c29-9307-f4faf2983676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.377860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a7b1b06a-139f-4c29-9307-f4faf2983676 None None] MFA Rules not processed for user `79d8c14781214d89880a896cab3e35fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:37.379083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a7b1b06a-139f-4c29-9307-f4faf2983676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:37.400794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9837-b865-4d66-aa79-7b19fd0afa4c None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.442161 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1239/2501] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:37.446298 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03656546-37dc-4044-8881-86cc0d310cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.446538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1b06a-139f-4c29-9307-f4faf2983676 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.446945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03656546-37dc-4044-8881-86cc0d310cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.447226 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03656546-37dc-4044-8881-86cc0d310cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.447492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03656546-37dc-4044-8881-86cc0d310cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.505024 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03656546-37dc-4044-8881-86cc0d310cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.506420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1b06a-139f-4c29-9307-f4faf2983676 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.506573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03656546-37dc-4044-8881-86cc0d310cf3 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.510927 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3fa5f-29ae-48f6-878b-c562cfdf6772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.511573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3fa5f-29ae-48f6-878b-c562cfdf6772 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.511851 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3fa5f-29ae-48f6-878b-c562cfdf6772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.512119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3fa5f-29ae-48f6-878b-c562cfdf6772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.512816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3fa5f-29ae-48f6-878b-c562cfdf6772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.514746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3fa5f-29ae-48f6-878b-c562cfdf6772 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.516487 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1263/2502] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:37.601452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1240/2503] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:37 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:37.602941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03656546-37dc-4044-8881-86cc0d310cf3 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.614387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03656546-37dc-4044-8881-86cc0d310cf3 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.675945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292ce20-1d64-4654-9142-410b80c60344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.676775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292ce20-1d64-4654-9142-410b80c60344 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.677125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292ce20-1d64-4654-9142-410b80c60344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.677401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292ce20-1d64-4654-9142-410b80c60344 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.678104 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292ce20-1d64-4654-9142-410b80c60344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.680013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292ce20-1d64-4654-9142-410b80c60344 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.746781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3fa5f-29ae-48f6-878b-c562cfdf6772 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.758901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1264/2504] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:37 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:37.761989 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292ce20-1d64-4654-9142-410b80c60344 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.771606 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292ce20-1d64-4654-9142-410b80c60344 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.776293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51180334-9413-4b95-857a-5af09e46bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.776932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51180334-9413-4b95-857a-5af09e46bdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.777215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51180334-9413-4b95-857a-5af09e46bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.777489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51180334-9413-4b95-857a-5af09e46bdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.778387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51180334-9413-4b95-857a-5af09e46bdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.779972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51180334-9413-4b95-857a-5af09e46bdb5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.793018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1265/2505] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:22:37.794238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51180334-9413-4b95-857a-5af09e46bdb5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.802870 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3fa5f-29ae-48f6-878b-c562cfdf6772 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.804250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51180334-9413-4b95-857a-5af09e46bdb5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.806505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fedb2-f065-416a-aa23-712166b3984e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.807149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fedb2-f065-416a-aa23-712166b3984e service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.807439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fedb2-f065-416a-aa23-712166b3984e service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.807714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fedb2-f065-416a-aa23-712166b3984e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.809194 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d0cdc-23b6-4f00-8fc4-91907261601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.809490 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bf5fedb2-f065-416a-aa23-712166b3984e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:37.810192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d0cdc-23b6-4f00-8fc4-91907261601d admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.810468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d0cdc-23b6-4f00-8fc4-91907261601d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.810741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d0cdc-23b6-4f00-8fc4-91907261601d admin admin] PATH_INFO: `/v3/projects/4b80f54276e04079be4c62138027484e/users/3e4b02f0b8b94e97a316b824db180fe0/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.826172 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d0cdc-23b6-4f00-8fc4-91907261601d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b80f54276e04079be4c62138027484e, user_id=3e4b02f0b8b94e97a316b824db180fe0, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.828914 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d0cdc-23b6-4f00-8fc4-91907261601d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.866803 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fedb2-f065-416a-aa23-712166b3984e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.868279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fedb2-f065-416a-aa23-712166b3984e service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.877697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1241/2506] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:22:37.899750 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1266/2507] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:37 2022] PUT /identity/v3/projects/4b80f54276e04079be4c62138027484e/users/3e4b02f0b8b94e97a316b824db180fe0/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:37.904145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fedb2-f065-416a-aa23-712166b3984e service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.915157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fedb2-f065-416a-aa23-712166b3984e service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:37.969753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a2d11-da6d-4a06-8c2e-a1e1e7db1693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:37.970372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a2d11-da6d-4a06-8c2e-a1e1e7db1693 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:37.970656 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a2d11-da6d-4a06-8c2e-a1e1e7db1693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:37.970931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a2d11-da6d-4a06-8c2e-a1e1e7db1693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:37.971644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a2d11-da6d-4a06-8c2e-a1e1e7db1693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:37.973315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a2d11-da6d-4a06-8c2e-a1e1e7db1693 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:37.983027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1242/2508] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:37.987830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d0cdc-23b6-4f00-8fc4-91907261601d admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:37.997986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d0cdc-23b6-4f00-8fc4-91907261601d admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:38.002738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87a68-5c0b-46a3-b6b7-9f2d7eb1bb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:38.003613 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87a68-5c0b-46a3-b6b7-9f2d7eb1bb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.003892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87a68-5c0b-46a3-b6b7-9f2d7eb1bb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.004165 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87a68-5c0b-46a3-b6b7-9f2d7eb1bb7c admin admin] PATH_INFO: `/v3/projects/4b80f54276e04079be4c62138027484e/users/3e4b02f0b8b94e97a316b824db180fe0/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.006275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87a68-5c0b-46a3-b6b7-9f2d7eb1bb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b80f54276e04079be4c62138027484e, user_id=3e4b02f0b8b94e97a316b824db180fe0, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:38.008911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87a68-5c0b-46a3-b6b7-9f2d7eb1bb7c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:38.019043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1267/2509] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:37 2022] PUT /identity/v3/projects/4b80f54276e04079be4c62138027484e/users/3e4b02f0b8b94e97a316b824db180fe0/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:38.044276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d7d1e-82d0-4b1e-9c1f-5956bd899a30 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.044564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d7d1e-82d0-4b1e-9c1f-5956bd899a30 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.044836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d7d1e-82d0-4b1e-9c1f-5956bd899a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.070949 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-730d7d1e-82d0-4b1e-9c1f-5956bd899a30 None None] MFA Rules not processed for user `3e4b02f0b8b94e97a316b824db180fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:38.072115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-730d7d1e-82d0-4b1e-9c1f-5956bd899a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.138846 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1243/2510] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:38.149854 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87a68-5c0b-46a3-b6b7-9f2d7eb1bb7c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:38.151580 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-88d87a68-5c0b-46a3-b6b7-9f2d7eb1bb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:38.206196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87a68-5c0b-46a3-b6b7-9f2d7eb1bb7c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:38.209893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eded2f6-6ffa-4c2b-8172-4ecc70ab8448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:38.210570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded2f6-6ffa-4c2b-8172-4ecc70ab8448 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.210849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded2f6-6ffa-4c2b-8172-4ecc70ab8448 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.211120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded2f6-6ffa-4c2b-8172-4ecc70ab8448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.220953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eded2f6-6ffa-4c2b-8172-4ecc70ab8448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:38.222391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eded2f6-6ffa-4c2b-8172-4ecc70ab8448 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:38.232120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1268/2511] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:38.355824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d7d1e-82d0-4b1e-9c1f-5956bd899a30 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:38.365419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d7d1e-82d0-4b1e-9c1f-5956bd899a30 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:38.369086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94170d3c-9cac-42fe-bdcf-c0fe07d58649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:38.369755 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170d3c-9cac-42fe-bdcf-c0fe07d58649 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:38.370038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170d3c-9cac-42fe-bdcf-c0fe07d58649 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:38.370351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170d3c-9cac-42fe-bdcf-c0fe07d58649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:38.425440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94170d3c-9cac-42fe-bdcf-c0fe07d58649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:38.427027 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94170d3c-9cac-42fe-bdcf-c0fe07d58649 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:38.435766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1244/2512] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:43.370206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eded2f6-6ffa-4c2b-8172-4ecc70ab8448 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:43.429654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eded2f6-6ffa-4c2b-8172-4ecc70ab8448 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:43.434672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:43.435603 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:43.435810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:43.436077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] PATH_INFO: `/v3/users/79d8c14781214d89880a896cab3e35fc` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:43.437261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d8c14781214d89880a896cab3e35fc)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:43.439204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:43.640476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d8c14781214d89880a896cab3e35fc'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:43.641135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d8c14781214d89880a896cab3e35fc'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:43.641724 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d8c14781214d89880a896cab3e35fc'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:43.653151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d8c14781214d89880a896cab3e35fc'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:43.659544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d8c14781214d89880a896cab3e35fc'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:43.726039 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1269/2513] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:43 2022] DELETE /identity/v3/users/79d8c14781214d89880a896cab3e35fc => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:43.733594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1e107-4b9f-46ff-9385-f9c3e1db35ee None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:43.733594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1e107-4b9f-46ff-9385-f9c3e1db35ee None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:43.733594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1e107-4b9f-46ff-9385-f9c3e1db35ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:43.748924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-27b1e107-4b9f-46ff-9385-f9c3e1db35ee None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:43.750133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-27b1e107-4b9f-46ff-9385-f9c3e1db35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:43.805692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1245/2514] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:43.815109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:43.816637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:43.870599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01757d77-519f-4daf-9de3-4039ccfcc6a9 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:43.874205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4743-9c8d-4c33-a237-163e48776ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:43.874860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4743-9c8d-4c33-a237-163e48776ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:43.875133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4743-9c8d-4c33-a237-163e48776ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:43.875403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c4743-9c8d-4c33-a237-163e48776ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:43.884012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c4743-9c8d-4c33-a237-163e48776ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:43.885455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c4743-9c8d-4c33-a237-163e48776ed0 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:43.894514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1270/2515] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:44.363936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1e107-4b9f-46ff-9385-f9c3e1db35ee None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:44.363936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-27b1e107-4b9f-46ff-9385-f9c3e1db35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:44.363936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1e107-4b9f-46ff-9385-f9c3e1db35ee None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:44.364712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:44.364712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:44.364712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:44.364712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] PATH_INFO: `/v3/projects/6238103aa4ea4f4998d0ea9ab0d175cf` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:44.365513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6238103aa4ea4f4998d0ea9ab0d175cf)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:44.365513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:44.416677 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6238103aa4ea4f4998d0ea9ab0d175cf', 'request_id': 'req-5edee7b9-60ca-4297-85ee-e459822d2923'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.422619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6238103aa4ea4f4998d0ea9ab0d175cf', 'request_id': 'req-5edee7b9-60ca-4297-85ee-e459822d2923'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.427919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6238103aa4ea4f4998d0ea9ab0d175cf', 'request_id': 'req-5edee7b9-60ca-4297-85ee-e459822d2923'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.491119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] The token cache is being invalidate because project 6238103aa4ea4f4998d0ea9ab0d175cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:44.491519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.492143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.493772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1246/2516] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:44 2022] DELETE /identity/v3/projects/6238103aa4ea4f4998d0ea9ab0d175cf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:44.497796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4743-9c8d-4c33-a237-163e48776ed0 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:44.507793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c4743-9c8d-4c33-a237-163e48776ed0 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:44.563625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:44.564486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:44.564767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:44.565044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] PATH_INFO: `/v3/users/3e4b02f0b8b94e97a316b824db180fe0` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:44.566268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4b02f0b8b94e97a316b824db180fe0)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:44.568326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:44.744757 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4b02f0b8b94e97a316b824db180fe0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.746180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4b02f0b8b94e97a316b824db180fe0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.746180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4b02f0b8b94e97a316b824db180fe0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.758081 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4b02f0b8b94e97a316b824db180fe0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.764446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-dbd8e577-c63c-4515-a704-c0a08ad7c006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4b02f0b8b94e97a316b824db180fe0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:44.862428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1271/2517] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:44 2022] DELETE /identity/v3/users/3e4b02f0b8b94e97a316b824db180fe0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:45.269441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:45.273906 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:45.290955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edee7b9-60ca-4297-85ee-e459822d2923 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:45.363569 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:45.364577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.364856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.365129 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] PATH_INFO: `/v3/projects/4b80f54276e04079be4c62138027484e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.367077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b80f54276e04079be4c62138027484e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:45.369288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:45.498875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab634a7-f66c-4ded-a02b-8f0e4fa50ff7 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.499364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab634a7-f66c-4ded-a02b-8f0e4fa50ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.499456 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab634a7-f66c-4ded-a02b-8f0e4fa50ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.517277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7ab634a7-f66c-4ded-a02b-8f0e4fa50ff7 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:45.518516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7ab634a7-f66c-4ded-a02b-8f0e4fa50ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:45.521557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b80f54276e04079be4c62138027484e', 'request_id': 'req-f78a90af-8800-4268-896b-ee2cd061f2eb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.529642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b80f54276e04079be4c62138027484e', 'request_id': 'req-f78a90af-8800-4268-896b-ee2cd061f2eb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.538590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b80f54276e04079be4c62138027484e', 'request_id': 'req-f78a90af-8800-4268-896b-ee2cd061f2eb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.578710 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1272/2518] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:22:45.632879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] The token cache is being invalidate because project 4b80f54276e04079be4c62138027484e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:45.633177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.633802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f78a90af-8800-4268-896b-ee2cd061f2eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:45.635365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1247/2519] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:45 2022] DELETE /identity/v3/projects/4b80f54276e04079be4c62138027484e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:45.640540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ef41-2887-45f0-aad5-2bf8b48a5538 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.640540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ef41-2887-45f0-aad5-2bf8b48a5538 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.640832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861ef41-2887-45f0-aad5-2bf8b48a5538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.664055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8861ef41-2887-45f0-aad5-2bf8b48a5538 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:45.665287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8861ef41-2887-45f0-aad5-2bf8b48a5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:45.731351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1273/2520] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:45.740365 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b47a9-67c7-4818-9c48-293d820ce149 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.740933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b47a9-67c7-4818-9c48-293d820ce149 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.741312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b47a9-67c7-4818-9c48-293d820ce149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.762861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cc9b47a9-67c7-4818-9c48-293d820ce149 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:45.763997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cc9b47a9-67c7-4818-9c48-293d820ce149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:45.776474 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1248/2521] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:45.782323 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ef41-2887-45f0-aad5-2bf8b48a5538 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:45.788015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b47a9-67c7-4818-9c48-293d820ce149 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:45.792676 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861ef41-2887-45f0-aad5-2bf8b48a5538 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:45.793965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cc9b47a9-67c7-4818-9c48-293d820ce149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:45.800881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff524bf4-2f5b-40d0-b41a-b3883b0885f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:45.802018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524bf4-2f5b-40d0-b41a-b3883b0885f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.802535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524bf4-2f5b-40d0-b41a-b3883b0885f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.803038 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524bf4-2f5b-40d0-b41a-b3883b0885f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.804404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff524bf4-2f5b-40d0-b41a-b3883b0885f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:45.805059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff524bf4-2f5b-40d0-b41a-b3883b0885f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:45.809991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff524bf4-2f5b-40d0-b41a-b3883b0885f5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:45.827799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1274/2522] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:45.829202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff524bf4-2f5b-40d0-b41a-b3883b0885f5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:45.846430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff524bf4-2f5b-40d0-b41a-b3883b0885f5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:45.872534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70027f2a-3ea7-495c-9d10-77bff1630d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:45.873438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70027f2a-3ea7-495c-9d10-77bff1630d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.874069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70027f2a-3ea7-495c-9d10-77bff1630d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.874830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70027f2a-3ea7-495c-9d10-77bff1630d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.875995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70027f2a-3ea7-495c-9d10-77bff1630d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:45.880599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70027f2a-3ea7-495c-9d10-77bff1630d02 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:45.900377 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b47a9-67c7-4818-9c48-293d820ce149 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:45.906871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35415f24-27ef-4296-aa7e-9b8e43661ed4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:45.907526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35415f24-27ef-4296-aa7e-9b8e43661ed4 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:45.907854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35415f24-27ef-4296-aa7e-9b8e43661ed4 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:45.908132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35415f24-27ef-4296-aa7e-9b8e43661ed4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:45.909941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-35415f24-27ef-4296-aa7e-9b8e43661ed4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:45.921160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35415f24-27ef-4296-aa7e-9b8e43661ed4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:45.922822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35415f24-27ef-4296-aa7e-9b8e43661ed4 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:45.931278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1249/2523] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:22:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:22:46.032853 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1275/2524] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:45 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:46.038690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35415f24-27ef-4296-aa7e-9b8e43661ed4 service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:46.048326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35415f24-27ef-4296-aa7e-9b8e43661ed4 service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:46.125422 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bf953-ecfd-4d9e-a9ae-aa69224a280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:46.126382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bf953-ecfd-4d9e-a9ae-aa69224a280d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.126767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bf953-ecfd-4d9e-a9ae-aa69224a280d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.127179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bf953-ecfd-4d9e-a9ae-aa69224a280d admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.127970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bf953-ecfd-4d9e-a9ae-aa69224a280d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:46.130314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bf953-ecfd-4d9e-a9ae-aa69224a280d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:46.321940 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1250/2525] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:46 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:46.325972 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70027f2a-3ea7-495c-9d10-77bff1630d02 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:46.339795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70027f2a-3ea7-495c-9d10-77bff1630d02 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:46.344934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a948fda-1ee3-4489-bca4-8fa4572ad7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:46.345631 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a948fda-1ee3-4489-bca4-8fa4572ad7bf admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.345962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a948fda-1ee3-4489-bca4-8fa4572ad7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.346352 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a948fda-1ee3-4489-bca4-8fa4572ad7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.347354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a948fda-1ee3-4489-bca4-8fa4572ad7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:46.349258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a948fda-1ee3-4489-bca4-8fa4572ad7bf admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:46.362553 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1276/2526] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:46.365458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bf953-ecfd-4d9e-a9ae-aa69224a280d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:46.376373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bf953-ecfd-4d9e-a9ae-aa69224a280d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:46.381907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f689c3-7c72-40c9-88d5-19f82caabc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:46.382620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f689c3-7c72-40c9-88d5-19f82caabc09 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.382906 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f689c3-7c72-40c9-88d5-19f82caabc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.383181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f689c3-7c72-40c9-88d5-19f82caabc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.384077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f689c3-7c72-40c9-88d5-19f82caabc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:46.385688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f689c3-7c72-40c9-88d5-19f82caabc09 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:46.398095 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1251/2527] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:46.402300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a948fda-1ee3-4489-bca4-8fa4572ad7bf admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:46.417940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a948fda-1ee3-4489-bca4-8fa4572ad7bf admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:46.425675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6932fff-876e-4e8b-b042-10e3615df1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:46.426893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6932fff-876e-4e8b-b042-10e3615df1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.427314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6932fff-876e-4e8b-b042-10e3615df1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.427671 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6932fff-876e-4e8b-b042-10e3615df1e3 admin admin] PATH_INFO: `/v3/projects/cd5379832da24f1b8511fa2a0879fbbf/users/e854dffe74b945e59306515eec0842e6/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.448354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6932fff-876e-4e8b-b042-10e3615df1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5379832da24f1b8511fa2a0879fbbf, user_id=e854dffe74b945e59306515eec0842e6, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:46.451287 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6932fff-876e-4e8b-b042-10e3615df1e3 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:46.523749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1277/2528] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:46 2022] PUT /identity/v3/projects/cd5379832da24f1b8511fa2a0879fbbf/users/e854dffe74b945e59306515eec0842e6/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:46.525521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c57b-644f-4437-9b1a-ca33423754bd None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.525839 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c57b-644f-4437-9b1a-ca33423754bd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.526160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c57b-644f-4437-9b1a-ca33423754bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.554617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f1f6c57b-644f-4437-9b1a-ca33423754bd None None] MFA Rules not processed for user `e854dffe74b945e59306515eec0842e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:46.555833 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f1f6c57b-644f-4437-9b1a-ca33423754bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:46.628884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1252/2529] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:46.629820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6932fff-876e-4e8b-b042-10e3615df1e3 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:46.698457 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6932fff-876e-4e8b-b042-10e3615df1e3 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:46.703806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f08d4-ffd3-4761-890d-4413d0b7f95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:46.704544 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f08d4-ffd3-4761-890d-4413d0b7f95f admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.704891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f08d4-ffd3-4761-890d-4413d0b7f95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.705277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f08d4-ffd3-4761-890d-4413d0b7f95f admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.705977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f08d4-ffd3-4761-890d-4413d0b7f95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:46.707983 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f08d4-ffd3-4761-890d-4413d0b7f95f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:46.815079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1278/2530] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:46 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:46.819086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c57b-644f-4437-9b1a-ca33423754bd None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:46.831222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c57b-644f-4437-9b1a-ca33423754bd None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:46.908343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c9893-9ed8-4da5-8aa3-180520fbc5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:46.908918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c9893-9ed8-4da5-8aa3-180520fbc5da admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:46.909195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c9893-9ed8-4da5-8aa3-180520fbc5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:46.909463 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c9893-9ed8-4da5-8aa3-180520fbc5da admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:46.910195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c9893-9ed8-4da5-8aa3-180520fbc5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:46.913297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c9893-9ed8-4da5-8aa3-180520fbc5da admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.010599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1253/2531] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:46 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:47.014244 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f08d4-ffd3-4761-890d-4413d0b7f95f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.032898 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f08d4-ffd3-4761-890d-4413d0b7f95f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.042785 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304c1b-9960-4435-a502-3a58571458a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.043450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304c1b-9960-4435-a502-3a58571458a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.043725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304c1b-9960-4435-a502-3a58571458a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.043993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304c1b-9960-4435-a502-3a58571458a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.044719 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9304c1b-9960-4435-a502-3a58571458a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.046479 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9304c1b-9960-4435-a502-3a58571458a0 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.086197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1279/2532] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:47.088432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c9893-9ed8-4da5-8aa3-180520fbc5da admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.132108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c9893-9ed8-4da5-8aa3-180520fbc5da admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.137240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098cf4d-5b13-493e-b918-8f40f0d1d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.138261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098cf4d-5b13-493e-b918-8f40f0d1d2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.138815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098cf4d-5b13-493e-b918-8f40f0d1d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.139099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098cf4d-5b13-493e-b918-8f40f0d1d2c1 admin admin] PATH_INFO: `/v3/projects/0244b1aea9074d818b0fc35ed3d6d054/users/9f8b3e4ef7c149a3984ac409192f1442/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.155886 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098cf4d-5b13-493e-b918-8f40f0d1d2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0244b1aea9074d818b0fc35ed3d6d054, user_id=9f8b3e4ef7c149a3984ac409192f1442, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.164032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098cf4d-5b13-493e-b918-8f40f0d1d2c1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.245438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1254/2533] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:47 2022] PUT /identity/v3/projects/0244b1aea9074d818b0fc35ed3d6d054/users/9f8b3e4ef7c149a3984ac409192f1442/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:47.249445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304c1b-9960-4435-a502-3a58571458a0 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.261109 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304c1b-9960-4435-a502-3a58571458a0 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.326736 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81c469-aec2-42df-bbb5-e4d381c3b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.327434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c469-aec2-42df-bbb5-e4d381c3b785 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.327718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c469-aec2-42df-bbb5-e4d381c3b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.327990 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81c469-aec2-42df-bbb5-e4d381c3b785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.328718 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81c469-aec2-42df-bbb5-e4d381c3b785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.330395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81c469-aec2-42df-bbb5-e4d381c3b785 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.342102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1280/2534] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:47.346595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098cf4d-5b13-493e-b918-8f40f0d1d2c1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.357938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098cf4d-5b13-493e-b918-8f40f0d1d2c1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.362778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00626106-746e-4828-8909-732bed41c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.363662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626106-746e-4828-8909-732bed41c96a admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.363975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626106-746e-4828-8909-732bed41c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.364254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626106-746e-4828-8909-732bed41c96a admin admin] PATH_INFO: `/v3/projects/0244b1aea9074d818b0fc35ed3d6d054/users/9f8b3e4ef7c149a3984ac409192f1442/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.366394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00626106-746e-4828-8909-732bed41c96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0244b1aea9074d818b0fc35ed3d6d054, user_id=9f8b3e4ef7c149a3984ac409192f1442, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.371000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00626106-746e-4828-8909-732bed41c96a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.381625 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1255/2535] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:47 2022] PUT /identity/v3/projects/0244b1aea9074d818b0fc35ed3d6d054/users/9f8b3e4ef7c149a3984ac409192f1442/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:47.396985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5053ef6-7dcb-494c-809e-b6c3ef3b3821 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.397269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5053ef6-7dcb-494c-809e-b6c3ef3b3821 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.397541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5053ef6-7dcb-494c-809e-b6c3ef3b3821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.424841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-d5053ef6-7dcb-494c-809e-b6c3ef3b3821 None None] MFA Rules not processed for user `9f8b3e4ef7c149a3984ac409192f1442`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:47.426888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d5053ef6-7dcb-494c-809e-b6c3ef3b3821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:47.503810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1281/2536] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:47.520806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00626106-746e-4828-8909-732bed41c96a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.522625 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-00626106-746e-4828-8909-732bed41c96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:47.587184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00626106-746e-4828-8909-732bed41c96a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.592389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ff743-aa2a-4de0-b044-9fc6170c219b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.593272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ff743-aa2a-4de0-b044-9fc6170c219b service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.593620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ff743-aa2a-4de0-b044-9fc6170c219b service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.593983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ff743-aa2a-4de0-b044-9fc6170c219b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.604080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ff743-aa2a-4de0-b044-9fc6170c219b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.605532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ff743-aa2a-4de0-b044-9fc6170c219b service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.615621 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1256/2537] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:47.687192 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5053ef6-7dcb-494c-809e-b6c3ef3b3821 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:47.769279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5053ef6-7dcb-494c-809e-b6c3ef3b3821 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:47.775313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:47.776452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:47.776919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:47.777347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] PATH_INFO: `/v3/users/e854dffe74b945e59306515eec0842e6` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:47.779067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e854dffe74b945e59306515eec0842e6)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:47.781008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:47.965789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e854dffe74b945e59306515eec0842e6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.966497 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e854dffe74b945e59306515eec0842e6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.967233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e854dffe74b945e59306515eec0842e6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.982220 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e854dffe74b945e59306515eec0842e6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:47.989782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e854dffe74b945e59306515eec0842e6'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:48.063370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1282/2538] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:47 2022] DELETE /identity/v3/users/e854dffe74b945e59306515eec0842e6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:48.065700 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6421226-53be-43c3-9502-b78ec1ac07e9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.066408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6421226-53be-43c3-9502-b78ec1ac07e9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.067199 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6421226-53be-43c3-9502-b78ec1ac07e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.090134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e6421226-53be-43c3-9502-b78ec1ac07e9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:48.091436 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e6421226-53be-43c3-9502-b78ec1ac07e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:48.179290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1257/2539] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:48.186978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:48.189069 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:48.274112 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05114736-a8bd-426f-9036-35e91e38ad19 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:48.278078 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8138450-08a3-4634-a8b4-ff6aee656ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:48.278925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8138450-08a3-4634-a8b4-ff6aee656ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:48.279381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8138450-08a3-4634-a8b4-ff6aee656ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:48.279815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8138450-08a3-4634-a8b4-ff6aee656ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:48.291488 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8138450-08a3-4634-a8b4-ff6aee656ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:48.293147 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8138450-08a3-4634-a8b4-ff6aee656ab4 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:48.306235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1283/2540] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:49.158652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6421226-53be-43c3-9502-b78ec1ac07e9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:49.160564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e6421226-53be-43c3-9502-b78ec1ac07e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:49.176292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6421226-53be-43c3-9502-b78ec1ac07e9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:49.189337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:49.189337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:49.189337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:49.189337 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] PATH_INFO: `/v3/projects/cd5379832da24f1b8511fa2a0879fbbf` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:49.190170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5379832da24f1b8511fa2a0879fbbf)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:49.190170 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:49.356103 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5379832da24f1b8511fa2a0879fbbf', 'request_id': 'req-e4d52195-1929-4aa4-9761-c9c5f6681a63'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.363681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5379832da24f1b8511fa2a0879fbbf', 'request_id': 'req-e4d52195-1929-4aa4-9761-c9c5f6681a63'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.369889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5379832da24f1b8511fa2a0879fbbf', 'request_id': 'req-e4d52195-1929-4aa4-9761-c9c5f6681a63'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.435953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] The token cache is being invalidate because project cd5379832da24f1b8511fa2a0879fbbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:49.436581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.437450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.439535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1258/2541] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:49 2022] DELETE /identity/v3/projects/cd5379832da24f1b8511fa2a0879fbbf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:49.444282 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8138450-08a3-4634-a8b4-ff6aee656ab4 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:49.455083 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8138450-08a3-4634-a8b4-ff6aee656ab4 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:49.529569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:49.530506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:49.530777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:49.531407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] PATH_INFO: `/v3/users/9f8b3e4ef7c149a3984ac409192f1442` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:49.533053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8b3e4ef7c149a3984ac409192f1442)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:49.536333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:49.766493 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8b3e4ef7c149a3984ac409192f1442'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.767564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8b3e4ef7c149a3984ac409192f1442'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.768774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8b3e4ef7c149a3984ac409192f1442'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.782859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8b3e4ef7c149a3984ac409192f1442'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.792227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-327f821a-09f9-4983-b56c-96c91e41cab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8b3e4ef7c149a3984ac409192f1442'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:49.860360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1284/2542] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:49 2022] DELETE /identity/v3/users/9f8b3e4ef7c149a3984ac409192f1442 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:50.306782 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.308909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.323003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d52195-1929-4aa4-9761-c9c5f6681a63 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.396852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.397719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.397998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.398298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] PATH_INFO: `/v3/projects/0244b1aea9074d818b0fc35ed3d6d054` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.399478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=0244b1aea9074d818b0fc35ed3d6d054)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.401440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.501047 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0244b1aea9074d818b0fc35ed3d6d054', 'request_id': 'req-ef8734a6-96d2-438e-be3f-87d791537dde'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.507319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0244b1aea9074d818b0fc35ed3d6d054', 'request_id': 'req-ef8734a6-96d2-438e-be3f-87d791537dde'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.513009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0244b1aea9074d818b0fc35ed3d6d054', 'request_id': 'req-ef8734a6-96d2-438e-be3f-87d791537dde'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.561372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] The token cache is being invalidate because project 0244b1aea9074d818b0fc35ed3d6d054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:50.561659 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.562343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ef8734a6-96d2-438e-be3f-87d791537dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:50.563996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1259/2543] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:50 2022] DELETE /identity/v3/projects/0244b1aea9074d818b0fc35ed3d6d054 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:50.569281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b61f2-2680-4f79-9c73-9d4db58fe6d1 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.569765 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b61f2-2680-4f79-9c73-9d4db58fe6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.569864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b61f2-2680-4f79-9c73-9d4db58fe6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.589533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9e2b61f2-2680-4f79-9c73-9d4db58fe6d1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:50.590808 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9e2b61f2-2680-4f79-9c73-9d4db58fe6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.664997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1285/2544] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:50.672786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70188-c287-4bee-91dc-0a9f3c4ed796 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.673151 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70188-c287-4bee-91dc-0a9f3c4ed796 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.673484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70188-c287-4bee-91dc-0a9f3c4ed796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.693107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6ab70188-c287-4bee-91dc-0a9f3c4ed796 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:50.694351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6ab70188-c287-4bee-91dc-0a9f3c4ed796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:50.702848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1260/2545] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:50.708542 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b61f2-2680-4f79-9c73-9d4db58fe6d1 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.725727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b61f2-2680-4f79-9c73-9d4db58fe6d1 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.733638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59ea3-6250-4ec0-93d3-d58d8cc55d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.734797 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59ea3-6250-4ec0-93d3-d58d8cc55d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.735263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59ea3-6250-4ec0-93d3-d58d8cc55d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.735738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59ea3-6250-4ec0-93d3-d58d8cc55d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.737643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a59ea3-6250-4ec0-93d3-d58d8cc55d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:50.738265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a59ea3-6250-4ec0-93d3-d58d8cc55d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.741398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a59ea3-6250-4ec0-93d3-d58d8cc55d70 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.775820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1286/2546] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:50.780844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70188-c287-4bee-91dc-0a9f3c4ed796 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.790786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70188-c287-4bee-91dc-0a9f3c4ed796 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.798774 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055277b-b2e4-477d-a994-4b1e8dc696b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.799980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055277b-b2e4-477d-a994-4b1e8dc696b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.800259 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055277b-b2e4-477d-a994-4b1e8dc696b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.800528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055277b-b2e4-477d-a994-4b1e8dc696b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.801218 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055277b-b2e4-477d-a994-4b1e8dc696b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.803159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055277b-b2e4-477d-a994-4b1e8dc696b8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:50.889369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1261/2547] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:50.898964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59ea3-6250-4ec0-93d3-d58d8cc55d70 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:50.918475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a59ea3-6250-4ec0-93d3-d58d8cc55d70 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:50.984363 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50355c8b-0ddc-4615-92cf-03f5e6802aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:50.986067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355c8b-0ddc-4615-92cf-03f5e6802aed admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:50.986440 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355c8b-0ddc-4615-92cf-03f5e6802aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:50.986715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355c8b-0ddc-4615-92cf-03f5e6802aed admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:50.987431 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50355c8b-0ddc-4615-92cf-03f5e6802aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:50.989622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50355c8b-0ddc-4615-92cf-03f5e6802aed admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.093756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1287/2548] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:50 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:51.096676 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055277b-b2e4-477d-a994-4b1e8dc696b8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.106729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055277b-b2e4-477d-a994-4b1e8dc696b8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.111610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829aff6-0145-47e9-bc5a-cfd98b95c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.112381 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829aff6-0145-47e9-bc5a-cfd98b95c429 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.112767 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829aff6-0145-47e9-bc5a-cfd98b95c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.113115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829aff6-0145-47e9-bc5a-cfd98b95c429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.115971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829aff6-0145-47e9-bc5a-cfd98b95c429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.119789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829aff6-0145-47e9-bc5a-cfd98b95c429 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.136842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1262/2549] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:51.141515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50355c8b-0ddc-4615-92cf-03f5e6802aed admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.152976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50355c8b-0ddc-4615-92cf-03f5e6802aed admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.160420 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d531b5c-3842-4d80-a7e3-2fdb9e60c0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.161272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d531b5c-3842-4d80-a7e3-2fdb9e60c0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.161657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d531b5c-3842-4d80-a7e3-2fdb9e60c0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.163110 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d531b5c-3842-4d80-a7e3-2fdb9e60c0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.166386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d531b5c-3842-4d80-a7e3-2fdb9e60c0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.166386 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d531b5c-3842-4d80-a7e3-2fdb9e60c0ca admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.183519 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1288/2550] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:51.185008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829aff6-0145-47e9-bc5a-cfd98b95c429 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.199928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829aff6-0145-47e9-bc5a-cfd98b95c429 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.205816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4c854-58e5-484d-8b97-145dbd0cb784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.207057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4c854-58e5-484d-8b97-145dbd0cb784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.207478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4c854-58e5-484d-8b97-145dbd0cb784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.207851 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4c854-58e5-484d-8b97-145dbd0cb784 admin admin] PATH_INFO: `/v3/projects/d2386904ce4f4b6b81b0e1813da00dbf/users/a560add6a5a44619aeeac665841cec97/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.229304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4c854-58e5-484d-8b97-145dbd0cb784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2386904ce4f4b6b81b0e1813da00dbf, user_id=a560add6a5a44619aeeac665841cec97, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.232658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4c854-58e5-484d-8b97-145dbd0cb784 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.334606 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1263/2551] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:51 2022] PUT /identity/v3/projects/d2386904ce4f4b6b81b0e1813da00dbf/users/a560add6a5a44619aeeac665841cec97/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:51.345806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b715-6cef-4b31-8eef-e8e18c7fd7f7 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.345996 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b715-6cef-4b31-8eef-e8e18c7fd7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.346223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b715-6cef-4b31-8eef-e8e18c7fd7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.379665 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-5804b715-6cef-4b31-8eef-e8e18c7fd7f7 None None] MFA Rules not processed for user `a560add6a5a44619aeeac665841cec97`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:51.381354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5804b715-6cef-4b31-8eef-e8e18c7fd7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:51.458202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1289/2552] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:51.463200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4c854-58e5-484d-8b97-145dbd0cb784 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.533999 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4c854-58e5-484d-8b97-145dbd0cb784 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.542265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cccfcc-bbee-4edc-9be0-f0ab53eb2c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.543063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cccfcc-bbee-4edc-9be0-f0ab53eb2c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.543427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cccfcc-bbee-4edc-9be0-f0ab53eb2c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.543860 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cccfcc-bbee-4edc-9be0-f0ab53eb2c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.544694 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cccfcc-bbee-4edc-9be0-f0ab53eb2c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.546824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cccfcc-bbee-4edc-9be0-f0ab53eb2c0f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.640399 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1264/2553] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:51.641871 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b715-6cef-4b31-8eef-e8e18c7fd7f7 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.657518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b715-6cef-4b31-8eef-e8e18c7fd7f7 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.724360 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8ef96-b8a4-4068-b79b-7009b0d28f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.725150 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ef96-b8a4-4068-b79b-7009b0d28f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.725526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ef96-b8a4-4068-b79b-7009b0d28f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.725892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ef96-b8a4-4068-b79b-7009b0d28f06 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.728950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8ef96-b8a4-4068-b79b-7009b0d28f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.728950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8ef96-b8a4-4068-b79b-7009b0d28f06 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.810430 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1290/2554] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:51 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:22:51.811887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cccfcc-bbee-4edc-9be0-f0ab53eb2c0f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.823505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cccfcc-bbee-4edc-9be0-f0ab53eb2c0f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.828319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093921ab-2e20-43b1-a240-d3696e9b5efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.828985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093921ab-2e20-43b1-a240-d3696e9b5efb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.829267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093921ab-2e20-43b1-a240-d3696e9b5efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.829631 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093921ab-2e20-43b1-a240-d3696e9b5efb admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.830389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093921ab-2e20-43b1-a240-d3696e9b5efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.832002 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093921ab-2e20-43b1-a240-d3696e9b5efb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.843335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1265/2555] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:51.848127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8ef96-b8a4-4068-b79b-7009b0d28f06 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.858825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8ef96-b8a4-4068-b79b-7009b0d28f06 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:51.864385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b01ba6-1c90-492d-b64a-63198bdc9f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:51.865292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01ba6-1c90-492d-b64a-63198bdc9f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:51.865571 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01ba6-1c90-492d-b64a-63198bdc9f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:51.865849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01ba6-1c90-492d-b64a-63198bdc9f4b admin admin] PATH_INFO: `/v3/projects/063e5ff0be264a71851bae4999aeecef/users/67ba3828f208483f9c2ea04b623aba55/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:51.882566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b01ba6-1c90-492d-b64a-63198bdc9f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=063e5ff0be264a71851bae4999aeecef, user_id=67ba3828f208483f9c2ea04b623aba55, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:51.885300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b01ba6-1c90-492d-b64a-63198bdc9f4b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:51.958084 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1291/2556] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:51 2022] PUT /identity/v3/projects/063e5ff0be264a71851bae4999aeecef/users/67ba3828f208483f9c2ea04b623aba55/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:51.974245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093921ab-2e20-43b1-a240-d3696e9b5efb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:51.974245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093921ab-2e20-43b1-a240-d3696e9b5efb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.034470 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd35ed3-a7c3-4c31-994a-b5c96786dec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.035142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd35ed3-a7c3-4c31-994a-b5c96786dec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.035424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd35ed3-a7c3-4c31-994a-b5c96786dec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.035702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd35ed3-a7c3-4c31-994a-b5c96786dec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.036426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd35ed3-a7c3-4c31-994a-b5c96786dec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.038169 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd35ed3-a7c3-4c31-994a-b5c96786dec3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.049136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1266/2557] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:22:52.053325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b01ba6-1c90-492d-b64a-63198bdc9f4b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.063945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b01ba6-1c90-492d-b64a-63198bdc9f4b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.068955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ea50d-30a1-48af-a9e3-546e7c8bf6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.069841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea50d-30a1-48af-a9e3-546e7c8bf6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.070161 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea50d-30a1-48af-a9e3-546e7c8bf6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.070444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ea50d-30a1-48af-a9e3-546e7c8bf6f6 admin admin] PATH_INFO: `/v3/projects/063e5ff0be264a71851bae4999aeecef/users/67ba3828f208483f9c2ea04b623aba55/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.072513 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ea50d-30a1-48af-a9e3-546e7c8bf6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063e5ff0be264a71851bae4999aeecef, user_id=67ba3828f208483f9c2ea04b623aba55, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.075326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ea50d-30a1-48af-a9e3-546e7c8bf6f6 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.086771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1292/2558] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:22:52 2022] PUT /identity/v3/projects/063e5ff0be264a71851bae4999aeecef/users/67ba3828f208483f9c2ea04b623aba55/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:52.100482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d00a5-cdb5-47b5-b383-a16d65b41ac8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.100822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d00a5-cdb5-47b5-b383-a16d65b41ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.101135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d00a5-cdb5-47b5-b383-a16d65b41ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.130623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-073d00a5-cdb5-47b5-b383-a16d65b41ac8 None None] MFA Rules not processed for user `67ba3828f208483f9c2ea04b623aba55`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:52.131835 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-073d00a5-cdb5-47b5-b383-a16d65b41ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:52.198013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1267/2559] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:52.209477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ea50d-30a1-48af-a9e3-546e7c8bf6f6 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.211235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4d7ea50d-30a1-48af-a9e3-546e7c8bf6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:52.268962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ea50d-30a1-48af-a9e3-546e7c8bf6f6 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.272612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7ec6-bd6b-46f0-b747-ec7734b473a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.273258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7ec6-bd6b-46f0-b747-ec7734b473a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.273541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7ec6-bd6b-46f0-b747-ec7734b473a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.273818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f7ec6-bd6b-46f0-b747-ec7734b473a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.283182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7ec6-bd6b-46f0-b747-ec7734b473a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.284623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f7ec6-bd6b-46f0-b747-ec7734b473a0 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.293930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1293/2560] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:52.342573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d00a5-cdb5-47b5-b383-a16d65b41ac8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:52.352906 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d00a5-cdb5-47b5-b383-a16d65b41ac8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:52.356418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980b35d-48df-4b22-a185-cc6fe7bf3c21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:52.357048 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980b35d-48df-4b22-a185-cc6fe7bf3c21 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:52.357329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980b35d-48df-4b22-a185-cc6fe7bf3c21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:52.357623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980b35d-48df-4b22-a185-cc6fe7bf3c21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:52.415030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980b35d-48df-4b22-a185-cc6fe7bf3c21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:52.416481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980b35d-48df-4b22-a185-cc6fe7bf3c21 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:52.425715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1268/2561] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:57.390087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7ec6-bd6b-46f0-b747-ec7734b473a0 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:57.450874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f7ec6-bd6b-46f0-b747-ec7734b473a0 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:57.456444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:57.459357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:57.459357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:57.459357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] PATH_INFO: `/v3/users/a560add6a5a44619aeeac665841cec97` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:57.459357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a560add6a5a44619aeeac665841cec97)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:57.461157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:57.627008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a560add6a5a44619aeeac665841cec97'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:57.627773 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a560add6a5a44619aeeac665841cec97'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:57.628583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a560add6a5a44619aeeac665841cec97'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:57.641695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a560add6a5a44619aeeac665841cec97'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:57.648380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a560add6a5a44619aeeac665841cec97'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:57.740748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1294/2562] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:57 2022] DELETE /identity/v3/users/a560add6a5a44619aeeac665841cec97 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:57.745424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4597374-7773-47db-8bcb-3521b0a36b35 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:57.745899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4597374-7773-47db-8bcb-3521b0a36b35 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:57.746014 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4597374-7773-47db-8bcb-3521b0a36b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:57.763817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b4597374-7773-47db-8bcb-3521b0a36b35 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:57.765012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b4597374-7773-47db-8bcb-3521b0a36b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:57.824201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1269/2563] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:57.833810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:57.835279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:57.909530 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c201f-5eb6-4a72-a463-a28eef100bcb admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:57.914086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e6283-8391-4397-bd6e-a9a1507485af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:57.916668 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6283-8391-4397-bd6e-a9a1507485af service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:57.916668 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6283-8391-4397-bd6e-a9a1507485af service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:57.916668 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6283-8391-4397-bd6e-a9a1507485af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:57.927921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e6283-8391-4397-bd6e-a9a1507485af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:57.929390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e6283-8391-4397-bd6e-a9a1507485af service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:57.939864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1295/2564] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:22:58.336035 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4597374-7773-47db-8bcb-3521b0a36b35 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:58.337551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b4597374-7773-47db-8bcb-3521b0a36b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:58.356964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4597374-7773-47db-8bcb-3521b0a36b35 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:58.362471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:58.363527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:58.363854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:58.364067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] PATH_INFO: `/v3/projects/d2386904ce4f4b6b81b0e1813da00dbf` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:58.366238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2386904ce4f4b6b81b0e1813da00dbf)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:58.367783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:58.460758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2386904ce4f4b6b81b0e1813da00dbf', 'request_id': 'req-fb967e08-2455-4bf4-9c42-f9338d3d204d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.467817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2386904ce4f4b6b81b0e1813da00dbf', 'request_id': 'req-fb967e08-2455-4bf4-9c42-f9338d3d204d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.473053 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2386904ce4f4b6b81b0e1813da00dbf', 'request_id': 'req-fb967e08-2455-4bf4-9c42-f9338d3d204d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.521983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] The token cache is being invalidate because project d2386904ce4f4b6b81b0e1813da00dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:58.522304 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.522911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.524478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1270/2565] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:58 2022] DELETE /identity/v3/projects/d2386904ce4f4b6b81b0e1813da00dbf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:58.528439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e6283-8391-4397-bd6e-a9a1507485af service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:58.537955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e6283-8391-4397-bd6e-a9a1507485af service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:58.591432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:58.592291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:58.592568 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:58.592835 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] PATH_INFO: `/v3/users/67ba3828f208483f9c2ea04b623aba55` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:58.593997 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ba3828f208483f9c2ea04b623aba55)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:58.595937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:58.804814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ba3828f208483f9c2ea04b623aba55'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.805473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ba3828f208483f9c2ea04b623aba55'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.806099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ba3828f208483f9c2ea04b623aba55'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.818193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ba3828f208483f9c2ea04b623aba55'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.824670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-145df8ac-79d6-4c01-a4b9-ba6fc7ffe7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ba3828f208483f9c2ea04b623aba55'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:58.876622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1296/2566] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:22:58 2022] DELETE /identity/v3/users/67ba3828f208483f9c2ea04b623aba55 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:22:59.250618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:59.252194 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:59.275090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb967e08-2455-4bf4-9c42-f9338d3d204d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:59.329634 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:59.330451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:59.330726 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:59.330997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] PATH_INFO: `/v3/projects/063e5ff0be264a71851bae4999aeecef` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:59.332162 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=063e5ff0be264a71851bae4999aeecef)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:59.334044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:59.472084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063e5ff0be264a71851bae4999aeecef', 'request_id': 'req-87f93dbd-ec92-4e6b-b184-669fc842dbb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.478450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063e5ff0be264a71851bae4999aeecef', 'request_id': 'req-87f93dbd-ec92-4e6b-b184-669fc842dbb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.484445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063e5ff0be264a71851bae4999aeecef', 'request_id': 'req-87f93dbd-ec92-4e6b-b184-669fc842dbb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.567271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] The token cache is being invalidate because project 063e5ff0be264a71851bae4999aeecef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:22:59.567584 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.568190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-87f93dbd-ec92-4e6b-b184-669fc842dbb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:22:59.569761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1271/2567] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:22:59 2022] DELETE /identity/v3/projects/063e5ff0be264a71851bae4999aeecef => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:22:59.580040 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad558e0-c790-4915-8f98-b1d4661aed64 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:59.580517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad558e0-c790-4915-8f98-b1d4661aed64 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:59.580517 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad558e0-c790-4915-8f98-b1d4661aed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:59.597893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3ad558e0-c790-4915-8f98-b1d4661aed64 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:59.599097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3ad558e0-c790-4915-8f98-b1d4661aed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:59.654592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1297/2568] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:59.662076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736abb2-b8b6-4018-b6ae-0f66f2fd691a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:59.662368 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736abb2-b8b6-4018-b6ae-0f66f2fd691a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:59.662639 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736abb2-b8b6-4018-b6ae-0f66f2fd691a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:59.680753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7736abb2-b8b6-4018-b6ae-0f66f2fd691a None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:22:59.681919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7736abb2-b8b6-4018-b6ae-0f66f2fd691a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:22:59.689489 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1272/2569] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:22:59.693398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad558e0-c790-4915-8f98-b1d4661aed64 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:59.703114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad558e0-c790-4915-8f98-b1d4661aed64 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:59.707561 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6325c1-a4ed-4058-a450-4914c4afee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:59.708197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6325c1-a4ed-4058-a450-4914c4afee46 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:59.708473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6325c1-a4ed-4058-a450-4914c4afee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:59.708742 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6325c1-a4ed-4058-a450-4914c4afee46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:59.709450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6325c1-a4ed-4058-a450-4914c4afee46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:22:59.709748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6325c1-a4ed-4058-a450-4914c4afee46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:59.711401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6325c1-a4ed-4058-a450-4914c4afee46 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:59.723504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1298/2570] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:22:59.727544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736abb2-b8b6-4018-b6ae-0f66f2fd691a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:59.736881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736abb2-b8b6-4018-b6ae-0f66f2fd691a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:59.741568 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adfd66-5f2d-416c-b195-2162402c59da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:59.742248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adfd66-5f2d-416c-b195-2162402c59da admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:59.742533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adfd66-5f2d-416c-b195-2162402c59da admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:59.742836 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adfd66-5f2d-416c-b195-2162402c59da admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:59.743524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adfd66-5f2d-416c-b195-2162402c59da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:59.745494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adfd66-5f2d-416c-b195-2162402c59da admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:22:59.858804 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1273/2571] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:22:59 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:22:59.859823 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6325c1-a4ed-4058-a450-4914c4afee46 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:22:59.870428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6325c1-a4ed-4058-a450-4914c4afee46 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:22:59.925799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c86dd-2a2b-4383-a7bb-da184e62444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:22:59.926593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c86dd-2a2b-4383-a7bb-da184e62444e admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:22:59.931279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c86dd-2a2b-4383-a7bb-da184e62444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:22:59.931279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c86dd-2a2b-4383-a7bb-da184e62444e admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:22:59.931279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c86dd-2a2b-4383-a7bb-da184e62444e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:22:59.931279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c86dd-2a2b-4383-a7bb-da184e62444e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.028970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1299/2572] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:22:59 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:00.030413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adfd66-5f2d-416c-b195-2162402c59da admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.040552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adfd66-5f2d-416c-b195-2162402c59da admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.045102 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24f526-ec80-4290-a965-67bf73b77e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.045754 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24f526-ec80-4290-a965-67bf73b77e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.046108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24f526-ec80-4290-a965-67bf73b77e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.046387 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24f526-ec80-4290-a965-67bf73b77e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.047099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24f526-ec80-4290-a965-67bf73b77e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.048681 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24f526-ec80-4290-a965-67bf73b77e2c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.058939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1274/2573] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:00.066634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c86dd-2a2b-4383-a7bb-da184e62444e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.077468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c86dd-2a2b-4383-a7bb-da184e62444e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.082327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f31c64-aa75-483a-8452-edf1939a00f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.082985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31c64-aa75-483a-8452-edf1939a00f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.083266 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31c64-aa75-483a-8452-edf1939a00f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.083985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31c64-aa75-483a-8452-edf1939a00f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.084251 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f31c64-aa75-483a-8452-edf1939a00f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.085841 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f31c64-aa75-483a-8452-edf1939a00f4 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.096148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1300/2574] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:00.100272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24f526-ec80-4290-a965-67bf73b77e2c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.110142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24f526-ec80-4290-a965-67bf73b77e2c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.114778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ec9c4-6e4e-456a-bbb1-d2dbc4990bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.115642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ec9c4-6e4e-456a-bbb1-d2dbc4990bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.115916 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ec9c4-6e4e-456a-bbb1-d2dbc4990bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.116182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ec9c4-6e4e-456a-bbb1-d2dbc4990bae admin admin] PATH_INFO: `/v3/projects/82af5d4a2eca4a78a9d3292b5555fc03/users/1bf5aa181de749f4aedab65868336168/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.130543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ec9c4-6e4e-456a-bbb1-d2dbc4990bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=82af5d4a2eca4a78a9d3292b5555fc03, user_id=1bf5aa181de749f4aedab65868336168, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.133167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ec9c4-6e4e-456a-bbb1-d2dbc4990bae admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.204071 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1275/2575] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:00 2022] PUT /identity/v3/projects/82af5d4a2eca4a78a9d3292b5555fc03/users/1bf5aa181de749f4aedab65868336168/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:00.214663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcd8f3-bdbd-4084-be6b-aafc5f08a6fe None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.215188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcd8f3-bdbd-4084-be6b-aafc5f08a6fe None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.215535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcd8f3-bdbd-4084-be6b-aafc5f08a6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.245173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-18dcd8f3-bdbd-4084-be6b-aafc5f08a6fe None None] MFA Rules not processed for user `1bf5aa181de749f4aedab65868336168`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:00.246434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-18dcd8f3-bdbd-4084-be6b-aafc5f08a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:00.318610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1301/2576] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:00.322757 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ec9c4-6e4e-456a-bbb1-d2dbc4990bae admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.385202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ec9c4-6e4e-456a-bbb1-d2dbc4990bae admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.390402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2508e-6edd-45ee-828f-4ec633211e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.391055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2508e-6edd-45ee-828f-4ec633211e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.391332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2508e-6edd-45ee-828f-4ec633211e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.391603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2508e-6edd-45ee-828f-4ec633211e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.392276 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2508e-6edd-45ee-828f-4ec633211e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.394236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2508e-6edd-45ee-828f-4ec633211e7e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.475197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1276/2577] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:23:00 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:00.482336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcd8f3-bdbd-4084-be6b-aafc5f08a6fe None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.492895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcd8f3-bdbd-4084-be6b-aafc5f08a6fe None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.545920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42969f-0206-4069-89fa-512d44d80eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.546605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42969f-0206-4069-89fa-512d44d80eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.546886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42969f-0206-4069-89fa-512d44d80eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.547157 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42969f-0206-4069-89fa-512d44d80eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.547867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42969f-0206-4069-89fa-512d44d80eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.549758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42969f-0206-4069-89fa-512d44d80eb8 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.645022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1302/2578] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:23:00 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:00.647130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2508e-6edd-45ee-828f-4ec633211e7e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.658672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2508e-6edd-45ee-828f-4ec633211e7e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.663063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee7cb1-9179-4a22-b6ec-c7a907ba5cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.663718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee7cb1-9179-4a22-b6ec-c7a907ba5cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.664114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee7cb1-9179-4a22-b6ec-c7a907ba5cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.664390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee7cb1-9179-4a22-b6ec-c7a907ba5cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.665112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee7cb1-9179-4a22-b6ec-c7a907ba5cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.666736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee7cb1-9179-4a22-b6ec-c7a907ba5cbe admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.678892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1277/2579] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:00.683034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42969f-0206-4069-89fa-512d44d80eb8 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.693906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42969f-0206-4069-89fa-512d44d80eb8 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.698758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413d3a-cbde-4885-9f40-095e5a28e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.699635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413d3a-cbde-4885-9f40-095e5a28e521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.699913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413d3a-cbde-4885-9f40-095e5a28e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.700185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413d3a-cbde-4885-9f40-095e5a28e521 admin admin] PATH_INFO: `/v3/projects/7ed2f9a6826448d281fbf55efd608f0c/users/bde3563566dd4d899902af5678a62446/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.715895 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413d3a-cbde-4885-9f40-095e5a28e521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed2f9a6826448d281fbf55efd608f0c, user_id=bde3563566dd4d899902af5678a62446, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.718783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413d3a-cbde-4885-9f40-095e5a28e521 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.787124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1303/2580] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:00 2022] PUT /identity/v3/projects/7ed2f9a6826448d281fbf55efd608f0c/users/bde3563566dd4d899902af5678a62446/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:00.791077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee7cb1-9179-4a22-b6ec-c7a907ba5cbe admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.802036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee7cb1-9179-4a22-b6ec-c7a907ba5cbe admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.861689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42657afa-9df1-470e-bfe3-174d578356f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.862421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42657afa-9df1-470e-bfe3-174d578356f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.862703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42657afa-9df1-470e-bfe3-174d578356f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.862976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42657afa-9df1-470e-bfe3-174d578356f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.863693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42657afa-9df1-470e-bfe3-174d578356f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.865300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42657afa-9df1-470e-bfe3-174d578356f7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.875206 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1278/2581] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:00.879314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413d3a-cbde-4885-9f40-095e5a28e521 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:00.890006 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413d3a-cbde-4885-9f40-095e5a28e521 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:00.900008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1453a35-3c0f-4d10-9776-635320a78de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:00.900888 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1453a35-3c0f-4d10-9776-635320a78de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.901166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1453a35-3c0f-4d10-9776-635320a78de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.901437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1453a35-3c0f-4d10-9776-635320a78de2 admin admin] PATH_INFO: `/v3/projects/7ed2f9a6826448d281fbf55efd608f0c/users/bde3563566dd4d899902af5678a62446/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.903977 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1453a35-3c0f-4d10-9776-635320a78de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed2f9a6826448d281fbf55efd608f0c, user_id=bde3563566dd4d899902af5678a62446, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:00.906660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1453a35-3c0f-4d10-9776-635320a78de2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:00.917056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1304/2582] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:00 2022] PUT /identity/v3/projects/7ed2f9a6826448d281fbf55efd608f0c/users/bde3563566dd4d899902af5678a62446/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:00.928519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bda92-736c-422b-bbbd-a110086e3e8e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:00.928806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bda92-736c-422b-bbbd-a110086e3e8e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:00.932701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bda92-736c-422b-bbbd-a110086e3e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:00.954593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-251bda92-736c-422b-bbbd-a110086e3e8e None None] MFA Rules not processed for user `bde3563566dd4d899902af5678a62446`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:00.955807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-251bda92-736c-422b-bbbd-a110086e3e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:01.025330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1279/2583] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:01.037300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1453a35-3c0f-4d10-9776-635320a78de2 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:01.038993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f1453a35-3c0f-4d10-9776-635320a78de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:01.096867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1453a35-3c0f-4d10-9776-635320a78de2 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:01.100557 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d26ec-33cd-48cb-b788-737c9ab9277b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:01.101193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d26ec-33cd-48cb-b788-737c9ab9277b service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:01.101471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d26ec-33cd-48cb-b788-737c9ab9277b service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:01.101740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d26ec-33cd-48cb-b788-737c9ab9277b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:01.111379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d26ec-33cd-48cb-b788-737c9ab9277b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:01.112794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d26ec-33cd-48cb-b788-737c9ab9277b service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:01.121947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1305/2584] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:01.293238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bda92-736c-422b-bbbd-a110086e3e8e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:01.302616 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bda92-736c-422b-bbbd-a110086e3e8e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:01.306332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f03b35-6cec-476e-8882-a3d60739c8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:01.306969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f03b35-6cec-476e-8882-a3d60739c8cc service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:01.307330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f03b35-6cec-476e-8882-a3d60739c8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:01.307607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f03b35-6cec-476e-8882-a3d60739c8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:01.362952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f03b35-6cec-476e-8882-a3d60739c8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:01.364397 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f03b35-6cec-476e-8882-a3d60739c8cc service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:01.373203 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1280/2585] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:02.051033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bc3e8-59a0-46e2-a60d-701e1dfb5d38 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.051033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bc3e8-59a0-46e2-a60d-701e1dfb5d38 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.051656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bc3e8-59a0-46e2-a60d-701e1dfb5d38 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.052693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1306/2586] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:23:02.064733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67c64-f4b9-483a-9966-16369d30ecdb None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.069547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67c64-f4b9-483a-9966-16369d30ecdb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.069547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67c64-f4b9-483a-9966-16369d30ecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.104343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-caa67c64-f4b9-483a-9966-16369d30ecdb None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:02.105534 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-caa67c64-f4b9-483a-9966-16369d30ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:02.171089 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1281/2587] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:02.182585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bc3e8-59a0-46e2-a60d-701e1dfb5d38 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:02.185071 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-766bc3e8-59a0-46e2-a60d-701e1dfb5d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:02.261131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bc3e8-59a0-46e2-a60d-701e1dfb5d38 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:02.264756 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331a8a6-a419-4902-a5aa-ab5b562ff3c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9237b353da546989b399ee9702d1bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:02.265385 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331a8a6-a419-4902-a5aa-ab5b562ff3c2 service glance] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.265660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331a8a6-a419-4902-a5aa-ab5b562ff3c2 service glance] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.265927 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331a8a6-a419-4902-a5aa-ab5b562ff3c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.275771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331a8a6-a419-4902-a5aa-ab5b562ff3c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:02.277196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331a8a6-a419-4902-a5aa-ab5b562ff3c2 service glance] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.291991 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1307/2588] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:02.500260 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7077-de40-4216-a677-115e4d1d6e15 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.500781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7077-de40-4216-a677-115e4d1d6e15 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.500781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a7077-de40-4216-a677-115e4d1d6e15 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.502118 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1282/2589] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:23:02.507210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c119-cc3f-4565-983e-346a5c991f57 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.507495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c119-cc3f-4565-983e-346a5c991f57 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.507767 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2c119-cc3f-4565-983e-346a5c991f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.525283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-0dc2c119-cc3f-4565-983e-346a5c991f57 None None] MFA Rules not processed for user `aec8440b7bd84c2b9ce583a01adabf90`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:02.526556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0dc2c119-cc3f-4565-983e-346a5c991f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:02.575885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1308/2590] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:02.587513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a7077-de40-4216-a677-115e4d1d6e15 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:02.589508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2e1a7077-de40-4216-a677-115e4d1d6e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:02.602991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a7077-de40-4216-a677-115e4d1d6e15 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:02.607037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a39b5-1760-4a1a-b508-7b8e8ddabe25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:02.607662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a39b5-1760-4a1a-b508-7b8e8ddabe25 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.607943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a39b5-1760-4a1a-b508-7b8e8ddabe25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.608217 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a39b5-1760-4a1a-b508-7b8e8ddabe25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.614988 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a39b5-1760-4a1a-b508-7b8e8ddabe25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:02.616434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a39b5-1760-4a1a-b508-7b8e8ddabe25 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.623947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1283/2591] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:02.704794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e327-cb8b-43d8-834d-e0e28f8e3ca6 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.705163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e327-cb8b-43d8-834d-e0e28f8e3ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.705510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510e327-cb8b-43d8-834d-e0e28f8e3ca6 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.706981 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1309/2592] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:23:02.712564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d555a-84dd-4d8b-814d-0b60b0b071b6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.712845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d555a-84dd-4d8b-814d-0b60b0b071b6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.713126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d555a-84dd-4d8b-814d-0b60b0b071b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.732847 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-595d555a-84dd-4d8b-814d-0b60b0b071b6 None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:02.734130 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-595d555a-84dd-4d8b-814d-0b60b0b071b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:02.743563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1284/2593] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:02.753949 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510e327-cb8b-43d8-834d-e0e28f8e3ca6 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:02.765653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510e327-cb8b-43d8-834d-e0e28f8e3ca6 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:02.769645 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d828a-a6a2-4c32-b58b-7642c3004f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:02.771472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d828a-a6a2-4c32-b58b-7642c3004f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:02.771472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d828a-a6a2-4c32-b58b-7642c3004f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:02.771472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d828a-a6a2-4c32-b58b-7642c3004f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:02.781694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d828a-a6a2-4c32-b58b-7642c3004f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:02.783197 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d828a-a6a2-4c32-b58b-7642c3004f47 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:02.793590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1310/2594] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:11.282245 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c305d9-b8bf-4b5a-8bf5-2e477f46d543 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.282758 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c305d9-b8bf-4b5a-8bf5-2e477f46d543 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.282870 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c305d9-b8bf-4b5a-8bf5-2e477f46d543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.300650 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-79c305d9-b8bf-4b5a-8bf5-2e477f46d543 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:11.302877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-79c305d9-b8bf-4b5a-8bf5-2e477f46d543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:11.359331 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1285/2595] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:11.372604 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d828a-a6a2-4c32-b58b-7642c3004f47 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:11.375502 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-217d828a-a6a2-4c32-b58b-7642c3004f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:11.443085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d828a-a6a2-4c32-b58b-7642c3004f47 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:11.449128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c5e1e-8ee8-42d7-96ce-3a54f28a4d96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:11.450492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c5e1e-8ee8-42d7-96ce-3a54f28a4d96 service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.450851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c5e1e-8ee8-42d7-96ce-3a54f28a4d96 service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.451540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c5e1e-8ee8-42d7-96ce-3a54f28a4d96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.466306 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c5e1e-8ee8-42d7-96ce-3a54f28a4d96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:11.468257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c5e1e-8ee8-42d7-96ce-3a54f28a4d96 service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:11.484725 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1311/2596] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:23:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:23:11.636172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c305d9-b8bf-4b5a-8bf5-2e477f46d543 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:11.743583 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c305d9-b8bf-4b5a-8bf5-2e477f46d543 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:11.749750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:11.750854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:11.751158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:11.751596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] PATH_INFO: `/v3/users/1bf5aa181de749f4aedab65868336168` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:11.753320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf5aa181de749f4aedab65868336168)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:11.756110 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:11.920031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf5aa181de749f4aedab65868336168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.921020 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf5aa181de749f4aedab65868336168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.939000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf5aa181de749f4aedab65868336168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.940557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf5aa181de749f4aedab65868336168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:11.949152 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf5aa181de749f4aedab65868336168'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.055996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1286/2597] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:23:11 2022] DELETE /identity/v3/users/1bf5aa181de749f4aedab65868336168 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:12.059279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d700483-4471-42ee-ac70-f0cfd11252ff None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.059279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d700483-4471-42ee-ac70-f0cfd11252ff None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.065412 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d700483-4471-42ee-ac70-f0cfd11252ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.077717 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7d700483-4471-42ee-ac70-f0cfd11252ff None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:12.079269 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7d700483-4471-42ee-ac70-f0cfd11252ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:12.149065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1312/2598] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:12.160101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:12.161590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:12.228590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841582f5-017a-4258-949c-be284546f2f8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:12.233009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd872ad3-1e19-438b-a6f8-faf2c33fa46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:12.233670 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872ad3-1e19-438b-a6f8-faf2c33fa46c service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.233955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872ad3-1e19-438b-a6f8-faf2c33fa46c service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.234267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd872ad3-1e19-438b-a6f8-faf2c33fa46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.250753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd872ad3-1e19-438b-a6f8-faf2c33fa46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:12.252909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd872ad3-1e19-438b-a6f8-faf2c33fa46c service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:12.263985 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1287/2599] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:12.700127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d700483-4471-42ee-ac70-f0cfd11252ff None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:12.704019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7d700483-4471-42ee-ac70-f0cfd11252ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:12.727485 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d700483-4471-42ee-ac70-f0cfd11252ff None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:12.737324 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:12.738428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:12.738884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:12.739333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] PATH_INFO: `/v3/projects/82af5d4a2eca4a78a9d3292b5555fc03` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:12.742652 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82af5d4a2eca4a78a9d3292b5555fc03)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:12.750216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:12.885928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82af5d4a2eca4a78a9d3292b5555fc03', 'request_id': 'req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.959727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82af5d4a2eca4a78a9d3292b5555fc03', 'request_id': 'req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.966849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82af5d4a2eca4a78a9d3292b5555fc03', 'request_id': 'req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.982383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] The token cache is being invalidate because project 82af5d4a2eca4a78a9d3292b5555fc03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:12.983705 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.984627 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:12.986905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1313/2600] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:23:12 2022] DELETE /identity/v3/projects/82af5d4a2eca4a78a9d3292b5555fc03 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:12.991096 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd872ad3-1e19-438b-a6f8-faf2c33fa46c service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:13.007792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd872ad3-1e19-438b-a6f8-faf2c33fa46c service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:13.081341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:13.082721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:13.083024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:13.083455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] PATH_INFO: `/v3/users/bde3563566dd4d899902af5678a62446` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:13.084880 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde3563566dd4d899902af5678a62446)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:13.087351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:13.296334 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde3563566dd4d899902af5678a62446'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.297744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde3563566dd4d899902af5678a62446'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.309772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde3563566dd4d899902af5678a62446'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.310518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde3563566dd4d899902af5678a62446'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.317818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5eb8d8e9-aeb6-43e6-a519-27120ff90368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde3563566dd4d899902af5678a62446'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:13.401099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1288/2601] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:23:12 2022] DELETE /identity/v3/users/bde3563566dd4d899902af5678a62446 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:13.808050 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:13.812186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:13.845801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9c40-dc1d-4346-9bcf-bd44bcdb1955 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:13.958690 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:13.959810 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:13.960160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:13.960518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] PATH_INFO: `/v3/projects/7ed2f9a6826448d281fbf55efd608f0c` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:13.962239 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed2f9a6826448d281fbf55efd608f0c)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:13.964202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.096590 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed2f9a6826448d281fbf55efd608f0c', 'request_id': 'req-a4138b18-af51-4e9f-9caf-42f74582366f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.165280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed2f9a6826448d281fbf55efd608f0c', 'request_id': 'req-a4138b18-af51-4e9f-9caf-42f74582366f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.172782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed2f9a6826448d281fbf55efd608f0c', 'request_id': 'req-a4138b18-af51-4e9f-9caf-42f74582366f'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.185742 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] The token cache is being invalidate because project 7ed2f9a6826448d281fbf55efd608f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:14.186008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.186852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a4138b18-af51-4e9f-9caf-42f74582366f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:14.189845 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1314/2602] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:23:13 2022] DELETE /identity/v3/projects/7ed2f9a6826448d281fbf55efd608f0c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:14.196265 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401b7c-c643-4383-a45a-b93ecfebb854 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.196805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401b7c-c643-4383-a45a-b93ecfebb854 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.196805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401b7c-c643-4383-a45a-b93ecfebb854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.221101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fb401b7c-c643-4383-a45a-b93ecfebb854 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:14.222320 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fb401b7c-c643-4383-a45a-b93ecfebb854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:14.292719 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1289/2603] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:14.295190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ae842-dc72-4387-9965-1495f671fa64 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.295190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ae842-dc72-4387-9965-1495f671fa64 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.295576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ae842-dc72-4387-9965-1495f671fa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.318520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-742ae842-dc72-4387-9965-1495f671fa64 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:14.319734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-742ae842-dc72-4387-9965-1495f671fa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:14.329255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1315/2604] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:14.333624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401b7c-c643-4383-a45a-b93ecfebb854 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.347483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401b7c-c643-4383-a45a-b93ecfebb854 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.353306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1b7ee-a32c-4718-984e-52f737f71565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.353975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1b7ee-a32c-4718-984e-52f737f71565 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.354293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1b7ee-a32c-4718-984e-52f737f71565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.354574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1b7ee-a32c-4718-984e-52f737f71565 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.355292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1b7ee-a32c-4718-984e-52f737f71565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:14.355684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1b7ee-a32c-4718-984e-52f737f71565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.357389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1b7ee-a32c-4718-984e-52f737f71565 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.370492 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1290/2605] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:14.375469 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ae842-dc72-4387-9965-1495f671fa64 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.385840 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ae842-dc72-4387-9965-1495f671fa64 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.391272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251898ff-7a7b-4829-9fa3-aadda119e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.391971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251898ff-7a7b-4829-9fa3-aadda119e046 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.392235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251898ff-7a7b-4829-9fa3-aadda119e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.392510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251898ff-7a7b-4829-9fa3-aadda119e046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.393204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251898ff-7a7b-4829-9fa3-aadda119e046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.395281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251898ff-7a7b-4829-9fa3-aadda119e046 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.509921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1316/2606] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:23:14 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:14.514669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1b7ee-a32c-4718-984e-52f737f71565 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.524415 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1b7ee-a32c-4718-984e-52f737f71565 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.587037 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67abd9-0d14-4c44-b626-525dd2e3bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.588058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67abd9-0d14-4c44-b626-525dd2e3bf92 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.588507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67abd9-0d14-4c44-b626-525dd2e3bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.589017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67abd9-0d14-4c44-b626-525dd2e3bf92 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.589996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67abd9-0d14-4c44-b626-525dd2e3bf92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.592483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67abd9-0d14-4c44-b626-525dd2e3bf92 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.677418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1291/2607] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:23:14 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:14.678643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251898ff-7a7b-4829-9fa3-aadda119e046 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.692185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251898ff-7a7b-4829-9fa3-aadda119e046 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.697535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd1ae-a635-4ed0-b097-c620cf892bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.705301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd1ae-a635-4ed0-b097-c620cf892bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.705301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd1ae-a635-4ed0-b097-c620cf892bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.705301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd1ae-a635-4ed0-b097-c620cf892bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.705301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd1ae-a635-4ed0-b097-c620cf892bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.705301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd1ae-a635-4ed0-b097-c620cf892bb0 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.713817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1317/2608] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:14.716444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67abd9-0d14-4c44-b626-525dd2e3bf92 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.727059 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67abd9-0d14-4c44-b626-525dd2e3bf92 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.732919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c320f-d0f7-4b61-baba-548d45536789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.733720 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c320f-d0f7-4b61-baba-548d45536789 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.734147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c320f-d0f7-4b61-baba-548d45536789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.734627 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c320f-d0f7-4b61-baba-548d45536789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.735510 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c320f-d0f7-4b61-baba-548d45536789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.737277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c320f-d0f7-4b61-baba-548d45536789 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.749523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1292/2609] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:14.753668 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd1ae-a635-4ed0-b097-c620cf892bb0 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.763745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd1ae-a635-4ed0-b097-c620cf892bb0 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:14.768216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa514f-f209-428a-8b2d-b57ef69f5d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:14.769072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa514f-f209-428a-8b2d-b57ef69f5d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.769345 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa514f-f209-428a-8b2d-b57ef69f5d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.769611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa514f-f209-428a-8b2d-b57ef69f5d74 admin admin] PATH_INFO: `/v3/projects/5c3413209905452cba36e8f4597f640e/users/de46906ad6d64270bc0c60408ca227e9/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.784329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa514f-f209-428a-8b2d-b57ef69f5d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3413209905452cba36e8f4597f640e, user_id=de46906ad6d64270bc0c60408ca227e9, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:14.787320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa514f-f209-428a-8b2d-b57ef69f5d74 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:14.863303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1318/2610] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:14 2022] PUT /identity/v3/projects/5c3413209905452cba36e8f4597f640e/users/de46906ad6d64270bc0c60408ca227e9/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:14.875030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea96e-d9b4-45e2-bd72-83134bcaef6b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:14.875431 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea96e-d9b4-45e2-bd72-83134bcaef6b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:14.875807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ea96e-d9b4-45e2-bd72-83134bcaef6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:14.905327 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4c7ea96e-d9b4-45e2-bd72-83134bcaef6b None None] MFA Rules not processed for user `de46906ad6d64270bc0c60408ca227e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:14.906708 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4c7ea96e-d9b4-45e2-bd72-83134bcaef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:14.972205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1293/2611] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:14.984347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa514f-f209-428a-8b2d-b57ef69f5d74 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:14.986434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5cfa514f-f209-428a-8b2d-b57ef69f5d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:15.056822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa514f-f209-428a-8b2d-b57ef69f5d74 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:15.060923 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac47a27-17b6-4666-8498-f1265df5f977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:15.061575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac47a27-17b6-4666-8498-f1265df5f977 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:15.061856 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac47a27-17b6-4666-8498-f1265df5f977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:15.062166 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac47a27-17b6-4666-8498-f1265df5f977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:15.070438 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac47a27-17b6-4666-8498-f1265df5f977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:15.071940 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac47a27-17b6-4666-8498-f1265df5f977 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:15.095399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1319/2612] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:17.580335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ea96e-d9b4-45e2-bd72-83134bcaef6b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:17.583564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4c7ea96e-d9b4-45e2-bd72-83134bcaef6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:17.612428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ea96e-d9b4-45e2-bd72-83134bcaef6b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:17.617896 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f058-5069-4856-a984-1a71fb85f2dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:17.618750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f058-5069-4856-a984-1a71fb85f2dc service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:17.619135 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f058-5069-4856-a984-1a71fb85f2dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:17.619693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f058-5069-4856-a984-1a71fb85f2dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:17.622271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5574f058-5069-4856-a984-1a71fb85f2dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:17.716271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574f058-5069-4856-a984-1a71fb85f2dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:17.717731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574f058-5069-4856-a984-1a71fb85f2dc service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:17.729205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1294/2613] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:21.457185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac47a27-17b6-4666-8498-f1265df5f977 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:21.517399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac47a27-17b6-4666-8498-f1265df5f977 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:21.521838 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:21.522715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.522995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.523261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] PATH_INFO: `/v3/users/de46906ad6d64270bc0c60408ca227e9` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.524547 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de46906ad6d64270bc0c60408ca227e9)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:21.526495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:21.697105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de46906ad6d64270bc0c60408ca227e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.697699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de46906ad6d64270bc0c60408ca227e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.698333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de46906ad6d64270bc0c60408ca227e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.709942 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de46906ad6d64270bc0c60408ca227e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.717152 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de46906ad6d64270bc0c60408ca227e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:21.775144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1320/2614] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:23:21 2022] DELETE /identity/v3/users/de46906ad6d64270bc0c60408ca227e9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:21.780487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f9f6-3368-4c84-be7f-97069ecfda10 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.781013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f9f6-3368-4c84-be7f-97069ecfda10 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.781013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f9f6-3368-4c84-be7f-97069ecfda10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.798229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5931f9f6-3368-4c84-be7f-97069ecfda10 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:21.799396 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5931f9f6-3368-4c84-be7f-97069ecfda10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.859480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1295/2615] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:21.869060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:21.870499 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:21.927354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4243a-15d9-47a5-98a7-27128e6a5e46 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:21.930970 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6de969-d58c-46cb-83a5-69563e1834a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:21.931607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de969-d58c-46cb-83a5-69563e1834a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:21.931905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de969-d58c-46cb-83a5-69563e1834a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:21.932160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de969-d58c-46cb-83a5-69563e1834a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:21.941259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6de969-d58c-46cb-83a5-69563e1834a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:21.942743 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6de969-d58c-46cb-83a5-69563e1834a9 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:21.952076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1321/2616] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:22.345998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931f9f6-3368-4c84-be7f-97069ecfda10 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:22.348453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5931f9f6-3368-4c84-be7f-97069ecfda10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:22.366788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931f9f6-3368-4c84-be7f-97069ecfda10 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:22.372273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:22.374493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:22.374493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:22.374493 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] PATH_INFO: `/v3/projects/5c3413209905452cba36e8f4597f640e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:22.375992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3413209905452cba36e8f4597f640e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:22.378447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:22.598800 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3413209905452cba36e8f4597f640e', 'request_id': 'req-805886e5-d91c-4d32-9644-50e071efc434'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.605437 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3413209905452cba36e8f4597f640e', 'request_id': 'req-805886e5-d91c-4d32-9644-50e071efc434'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.611021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3413209905452cba36e8f4597f640e', 'request_id': 'req-805886e5-d91c-4d32-9644-50e071efc434'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.678313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] The token cache is being invalidate because project 5c3413209905452cba36e8f4597f640e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:22.678597 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.679234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:22.680818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1296/2617] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:23:22 2022] DELETE /identity/v3/projects/5c3413209905452cba36e8f4597f640e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:28.842647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc19c1-6841-4d0c-8af8-036802c63f2e None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:28.843187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc19c1-6841-4d0c-8af8-036802c63f2e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:28.843187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc19c1-6841-4d0c-8af8-036802c63f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:28.859593 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9bdc19c1-6841-4d0c-8af8-036802c63f2e None None] MFA Rules not processed for user `b34f24054c204d7cb69ca41099913ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:28.860939 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9bdc19c1-6841-4d0c-8af8-036802c63f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:28.914503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1322/2618] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:30.349599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:30.351058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:30.416121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805886e5-d91c-4d32-9644-50e071efc434 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:30.421257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:30.422159 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:30.422445 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:30.422723 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] PATH_INFO: `/v3/users/8d82dd2687524ef1bb8d56bf4da5f121` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:30.424024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d82dd2687524ef1bb8d56bf4da5f121)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:30.426210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:30.641623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d82dd2687524ef1bb8d56bf4da5f121'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:30.642451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d82dd2687524ef1bb8d56bf4da5f121'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:30.655329 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d82dd2687524ef1bb8d56bf4da5f121'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:30.656186 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d82dd2687524ef1bb8d56bf4da5f121'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:30.663013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d82dd2687524ef1bb8d56bf4da5f121'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:30.780658 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1297/2619] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:23:30 2022] DELETE /identity/v3/users/8d82dd2687524ef1bb8d56bf4da5f121 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:30.785120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943d763-29d0-4e21-afc3-6456173755ae None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:30.785578 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943d763-29d0-4e21-afc3-6456173755ae None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:30.785695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943d763-29d0-4e21-afc3-6456173755ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:30.802622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-b943d763-29d0-4e21-afc3-6456173755ae None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:30.804354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b943d763-29d0-4e21-afc3-6456173755ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:30.860019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1323/2620] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:30.869584 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:30.871529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:30.926315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197b983-c189-47c3-b9de-54a0f5cc4717 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:30.929919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0eaa-64fc-473d-8ae5-ff6a7ca98147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:30.930590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0eaa-64fc-473d-8ae5-ff6a7ca98147 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:30.930872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0eaa-64fc-473d-8ae5-ff6a7ca98147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:30.931146 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0eaa-64fc-473d-8ae5-ff6a7ca98147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:30.940532 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0eaa-64fc-473d-8ae5-ff6a7ca98147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:30.942010 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0eaa-64fc-473d-8ae5-ff6a7ca98147 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:30.951816 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1298/2621] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:31.388644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943d763-29d0-4e21-afc3-6456173755ae None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:31.389143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b943d763-29d0-4e21-afc3-6456173755ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:31.400900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943d763-29d0-4e21-afc3-6456173755ae None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:31.405859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:31.406758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:31.407047 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:31.407326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] PATH_INFO: `/v3/projects/949b520db373441b9aa0191b5e4e7243` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:31.408550 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949b520db373441b9aa0191b5e4e7243)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:31.410545 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:31.505616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949b520db373441b9aa0191b5e4e7243', 'request_id': 'req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.558102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949b520db373441b9aa0191b5e4e7243', 'request_id': 'req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.563777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949b520db373441b9aa0191b5e4e7243', 'request_id': 'req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.574384 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] The token cache is being invalidate because project 949b520db373441b9aa0191b5e4e7243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:31.574669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.575279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.576816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1324/2622] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:23:31 2022] DELETE /identity/v3/projects/949b520db373441b9aa0191b5e4e7243 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:31.580738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0eaa-64fc-473d-8ae5-ff6a7ca98147 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:31.590867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0eaa-64fc-473d-8ae5-ff6a7ca98147 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:31.643899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:31.644761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:31.645038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:31.645308 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] PATH_INFO: `/v3/users/a89dc8c9a7ca4a95bedf7831e23431c0` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:31.646502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89dc8c9a7ca4a95bedf7831e23431c0)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:31.648395 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:31.816884 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89dc8c9a7ca4a95bedf7831e23431c0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.817905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89dc8c9a7ca4a95bedf7831e23431c0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.832257 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89dc8c9a7ca4a95bedf7831e23431c0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.832964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89dc8c9a7ca4a95bedf7831e23431c0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.840662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df58eb11-7266-4281-a8f5-642620f8dba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89dc8c9a7ca4a95bedf7831e23431c0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:31.912179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1299/2623] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:23:31 2022] DELETE /identity/v3/users/a89dc8c9a7ca4a95bedf7831e23431c0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:32.284908 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:32.289118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:32.300447 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a98b6-0514-4b25-9b3d-e14cd88608d9 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:32.358720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:32.359308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:32.359583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:32.359852 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] PATH_INFO: `/v3/projects/1fff3bbe12c246c1bb58ed41e2db28a6` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:32.361046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fff3bbe12c246c1bb58ed41e2db28a6)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:32.363023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:32.502268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fff3bbe12c246c1bb58ed41e2db28a6', 'request_id': 'req-5fa15b24-d063-47f5-942f-920dae19d8e4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:32.597843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fff3bbe12c246c1bb58ed41e2db28a6', 'request_id': 'req-5fa15b24-d063-47f5-942f-920dae19d8e4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:32.603779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fff3bbe12c246c1bb58ed41e2db28a6', 'request_id': 'req-5fa15b24-d063-47f5-942f-920dae19d8e4'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:32.615127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] The token cache is being invalidate because project 1fff3bbe12c246c1bb58ed41e2db28a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:32.615409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:32.616030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5fa15b24-d063-47f5-942f-920dae19d8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:32.617560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1325/2624] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:23:32 2022] DELETE /identity/v3/projects/1fff3bbe12c246c1bb58ed41e2db28a6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:32.623127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5c9a-5c27-4f5b-878b-6c3e0e3be8fc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:32.623647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5c9a-5c27-4f5b-878b-6c3e0e3be8fc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:32.623920 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5c9a-5c27-4f5b-878b-6c3e0e3be8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:32.642379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b48f5c9a-5c27-4f5b-878b-6c3e0e3be8fc None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:32.643671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b48f5c9a-5c27-4f5b-878b-6c3e0e3be8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:32.705277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1300/2625] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:32.714263 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09a83-3c7a-4d27-89b5-c37aedfe9650 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:32.714559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09a83-3c7a-4d27-89b5-c37aedfe9650 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:32.714836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca09a83-3c7a-4d27-89b5-c37aedfe9650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:32.733801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-9ca09a83-3c7a-4d27-89b5-c37aedfe9650 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:32.735115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-9ca09a83-3c7a-4d27-89b5-c37aedfe9650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:32.743334 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1326/2626] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:32.748255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5c9a-5c27-4f5b-878b-6c3e0e3be8fc None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:32.757653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5c9a-5c27-4f5b-878b-6c3e0e3be8fc None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:32.762189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a610eee-877c-4f09-b54a-3f59d2fc024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:32.762844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a610eee-877c-4f09-b54a-3f59d2fc024e admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:32.763122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a610eee-877c-4f09-b54a-3f59d2fc024e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:32.763388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a610eee-877c-4f09-b54a-3f59d2fc024e admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:32.764104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a610eee-877c-4f09-b54a-3f59d2fc024e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:32.764412 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a610eee-877c-4f09-b54a-3f59d2fc024e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:32.766116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a610eee-877c-4f09-b54a-3f59d2fc024e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:32.778350 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1301/2627] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:32.782514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca09a83-3c7a-4d27-89b5-c37aedfe9650 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:32.792460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca09a83-3c7a-4d27-89b5-c37aedfe9650 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:32.797216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c17ed4-6638-4074-8fd7-2af91c7f5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:32.797855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c17ed4-6638-4074-8fd7-2af91c7f5bef admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:32.798170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c17ed4-6638-4074-8fd7-2af91c7f5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:32.798439 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c17ed4-6638-4074-8fd7-2af91c7f5bef admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:32.799129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c17ed4-6638-4074-8fd7-2af91c7f5bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:32.801019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c17ed4-6638-4074-8fd7-2af91c7f5bef admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:32.913968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1327/2628] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:23:32 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:32.918498 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a610eee-877c-4f09-b54a-3f59d2fc024e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:32.928494 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a610eee-877c-4f09-b54a-3f59d2fc024e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:32.986210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20178d7f-ce3b-4182-9094-18a843558c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:32.986881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20178d7f-ce3b-4182-9094-18a843558c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:32.987164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20178d7f-ce3b-4182-9094-18a843558c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:32.987435 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20178d7f-ce3b-4182-9094-18a843558c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:32.988116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20178d7f-ce3b-4182-9094-18a843558c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:32.990023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20178d7f-ce3b-4182-9094-18a843558c27 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:33.063779 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1302/2629] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:23:32 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:33.065567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c17ed4-6638-4074-8fd7-2af91c7f5bef admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.076924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c17ed4-6638-4074-8fd7-2af91c7f5bef admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:33.083000 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9cdc-8450-47ca-afc3-65ec605fa0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:33.083554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9cdc-8450-47ca-afc3-65ec605fa0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.083837 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9cdc-8450-47ca-afc3-65ec605fa0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.084113 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f9cdc-8450-47ca-afc3-65ec605fa0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.087419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f9cdc-8450-47ca-afc3-65ec605fa0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:33.087419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f9cdc-8450-47ca-afc3-65ec605fa0b2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:33.101622 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1328/2630] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:33.102644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20178d7f-ce3b-4182-9094-18a843558c27 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.113418 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20178d7f-ce3b-4182-9094-18a843558c27 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:33.118310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb310c8-b17b-4efa-bb5e-e10a1684a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:33.121559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb310c8-b17b-4efa-bb5e-e10a1684a5de admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.121559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb310c8-b17b-4efa-bb5e-e10a1684a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.121839 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb310c8-b17b-4efa-bb5e-e10a1684a5de admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.122654 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb310c8-b17b-4efa-bb5e-e10a1684a5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:33.124273 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb310c8-b17b-4efa-bb5e-e10a1684a5de admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:33.134733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1303/2631] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:33.139031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9cdc-8450-47ca-afc3-65ec605fa0b2 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.148958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f9cdc-8450-47ca-afc3-65ec605fa0b2 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:33.154321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c4f91-8204-412a-befd-7f4509544fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:33.155203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c4f91-8204-412a-befd-7f4509544fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.155480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c4f91-8204-412a-befd-7f4509544fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.155758 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c4f91-8204-412a-befd-7f4509544fba admin admin] PATH_INFO: `/v3/projects/75e64887386e4680a7e0f147f7b00b1c/users/1c0122acfcea4f30a74dd262269ba6b9/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.172766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c4f91-8204-412a-befd-7f4509544fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e64887386e4680a7e0f147f7b00b1c, user_id=1c0122acfcea4f30a74dd262269ba6b9, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:33.175495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c4f91-8204-412a-befd-7f4509544fba admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:33.261090 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1329/2632] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:33 2022] PUT /identity/v3/projects/75e64887386e4680a7e0f147f7b00b1c/users/1c0122acfcea4f30a74dd262269ba6b9/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:33.271458 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9488b3-afef-4b68-93ca-ba06c2c8f9a7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.271746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9488b3-afef-4b68-93ca-ba06c2c8f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.272022 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9488b3-afef-4b68-93ca-ba06c2c8f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.300830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9f9488b3-afef-4b68-93ca-ba06c2c8f9a7 None None] MFA Rules not processed for user `1c0122acfcea4f30a74dd262269ba6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:33.302043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9f9488b3-afef-4b68-93ca-ba06c2c8f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:33.372622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1304/2633] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:33.377224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c4f91-8204-412a-befd-7f4509544fba admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.445442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c4f91-8204-412a-befd-7f4509544fba admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:33.451814 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7750-0249-4558-ba90-ea7cca804168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:33.452766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7750-0249-4558-ba90-ea7cca804168 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.453325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7750-0249-4558-ba90-ea7cca804168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.453801 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7750-0249-4558-ba90-ea7cca804168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.454779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7750-0249-4558-ba90-ea7cca804168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:33.457142 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7750-0249-4558-ba90-ea7cca804168 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:33.559387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1330/2634] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:23:33 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:33.560502 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9488b3-afef-4b68-93ca-ba06c2c8f9a7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.571814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9488b3-afef-4b68-93ca-ba06c2c8f9a7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:33.630811 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1af733-4dcd-4537-909a-7f70b1e3fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:33.631512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1af733-4dcd-4537-909a-7f70b1e3fe0a admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.631793 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1af733-4dcd-4537-909a-7f70b1e3fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.632106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1af733-4dcd-4537-909a-7f70b1e3fe0a admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.632761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1af733-4dcd-4537-909a-7f70b1e3fe0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:33.634714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1af733-4dcd-4537-909a-7f70b1e3fe0a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:33.715706 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1305/2635] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:23:33 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:33.717200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7750-0249-4558-ba90-ea7cca804168 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.727641 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7750-0249-4558-ba90-ea7cca804168 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:33.732562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b9916-6be7-425f-81af-4d692b79406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:33.733319 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9916-6be7-425f-81af-4d692b79406f admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.733764 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9916-6be7-425f-81af-4d692b79406f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.734046 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b9916-6be7-425f-81af-4d692b79406f admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.734791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b9916-6be7-425f-81af-4d692b79406f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:33.736510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b9916-6be7-425f-81af-4d692b79406f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:33.751646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1331/2636] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:33.755562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1af733-4dcd-4537-909a-7f70b1e3fe0a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.766855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1af733-4dcd-4537-909a-7f70b1e3fe0a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:33.771632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d95e9-5c47-4171-abb3-ec668afaa835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:33.772509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d95e9-5c47-4171-abb3-ec668afaa835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.772789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d95e9-5c47-4171-abb3-ec668afaa835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.773062 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d95e9-5c47-4171-abb3-ec668afaa835 admin admin] PATH_INFO: `/v3/projects/2714b994f8ce4008a8ee3cd198087c52/users/da40babd334549f881d4fb2183a50f6d/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.787622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d95e9-5c47-4171-abb3-ec668afaa835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2714b994f8ce4008a8ee3cd198087c52, user_id=da40babd334549f881d4fb2183a50f6d, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:33.790287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d95e9-5c47-4171-abb3-ec668afaa835 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:33.842481 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672b1be-8769-4555-8721-ed05eaee3fbe None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.842770 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672b1be-8769-4555-8721-ed05eaee3fbe None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.843065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672b1be-8769-4555-8721-ed05eaee3fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.862028 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-8672b1be-8769-4555-8721-ed05eaee3fbe None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:33.863274 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8672b1be-8769-4555-8721-ed05eaee3fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:33.874123 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1306/2637] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:33 2022] PUT /identity/v3/projects/2714b994f8ce4008a8ee3cd198087c52/users/da40babd334549f881d4fb2183a50f6d/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:33.878191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d95e9-5c47-4171-abb3-ec668afaa835 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.936158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1332/2638] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 16 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:23:33.960596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672b1be-8769-4555-8721-ed05eaee3fbe None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:33.961753 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d95e9-5c47-4171-abb3-ec668afaa835 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:33.962549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-8672b1be-8769-4555-8721-ed05eaee3fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:33.973511 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40ee43-804d-427a-af8c-21de0e22ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:33.974162 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40ee43-804d-427a-af8c-21de0e22ac27 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:33.974451 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40ee43-804d-427a-af8c-21de0e22ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:33.974728 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40ee43-804d-427a-af8c-21de0e22ac27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:33.975544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40ee43-804d-427a-af8c-21de0e22ac27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:33.977112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40ee43-804d-427a-af8c-21de0e22ac27 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:33.988187 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1307/2639] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:33.992628 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40ee43-804d-427a-af8c-21de0e22ac27 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:34.011892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40ee43-804d-427a-af8c-21de0e22ac27 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:34.017163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4f624-aa3f-46c2-88b0-2c391f92a0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:34.018250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4f624-aa3f-46c2-88b0-2c391f92a0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:34.018656 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4f624-aa3f-46c2-88b0-2c391f92a0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:34.019036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4f624-aa3f-46c2-88b0-2c391f92a0fb admin admin] PATH_INFO: `/v3/projects/2714b994f8ce4008a8ee3cd198087c52/users/da40babd334549f881d4fb2183a50f6d/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:34.026523 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4f624-aa3f-46c2-88b0-2c391f92a0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2714b994f8ce4008a8ee3cd198087c52, user_id=da40babd334549f881d4fb2183a50f6d, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:34.030599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4f624-aa3f-46c2-88b0-2c391f92a0fb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:34.043902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1308/2640] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:33 2022] PUT /identity/v3/projects/2714b994f8ce4008a8ee3cd198087c52/users/da40babd334549f881d4fb2183a50f6d/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:34.051686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672b1be-8769-4555-8721-ed05eaee3fbe None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:34.055275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998796-2972-4ca6-a9e5-e0d65df7d6b3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:34.056231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998796-2972-4ca6-a9e5-e0d65df7d6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:34.056585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998796-2972-4ca6-a9e5-e0d65df7d6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:34.093854 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0b998796-2972-4ca6-a9e5-e0d65df7d6b3 None None] MFA Rules not processed for user `da40babd334549f881d4fb2183a50f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:34.096319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0b998796-2972-4ca6-a9e5-e0d65df7d6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:34.128225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7872ff7-4eb5-4611-92a4-a38328a96136 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:34.128775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7872ff7-4eb5-4611-92a4-a38328a96136 service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:34.129059 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7872ff7-4eb5-4611-92a4-a38328a96136 service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:34.129382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7872ff7-4eb5-4611-92a4-a38328a96136 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:34.201874 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7872ff7-4eb5-4611-92a4-a38328a96136 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:34.203621 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7872ff7-4eb5-4611-92a4-a38328a96136 service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:34.212811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1333/2641] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:23:34.219104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1309/2642] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:34.231861 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7872ff7-4eb5-4611-92a4-a38328a96136 service swift] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:34.233698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e7872ff7-4eb5-4611-92a4-a38328a96136 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:34.291065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7872ff7-4eb5-4611-92a4-a38328a96136 service swift] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:34.295299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3557ef-47fb-4394-9399-24b9b1038e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:34.295950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3557ef-47fb-4394-9399-24b9b1038e1a service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:34.296230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3557ef-47fb-4394-9399-24b9b1038e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:34.296504 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3557ef-47fb-4394-9399-24b9b1038e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:34.312288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3557ef-47fb-4394-9399-24b9b1038e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:34.313866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3557ef-47fb-4394-9399-24b9b1038e1a service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:34.335695 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1334/2643] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:35.357043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b998796-2972-4ca6-a9e5-e0d65df7d6b3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:35.426452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b998796-2972-4ca6-a9e5-e0d65df7d6b3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:35.432585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:35.433558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:35.433910 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:35.434353 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] PATH_INFO: `/v3/users/1c0122acfcea4f30a74dd262269ba6b9` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:35.435855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0122acfcea4f30a74dd262269ba6b9)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:35.438219 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:35.565163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0122acfcea4f30a74dd262269ba6b9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.565729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0122acfcea4f30a74dd262269ba6b9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.576852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0122acfcea4f30a74dd262269ba6b9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.577469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0122acfcea4f30a74dd262269ba6b9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.584065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0122acfcea4f30a74dd262269ba6b9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:35.664891 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1310/2644] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:23:35 2022] DELETE /identity/v3/users/1c0122acfcea4f30a74dd262269ba6b9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:35.670041 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77587-82bf-4afe-9936-b575be8881f9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:35.670534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77587-82bf-4afe-9936-b575be8881f9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:35.670633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e77587-82bf-4afe-9936-b575be8881f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:35.687620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-70e77587-82bf-4afe-9936-b575be8881f9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:35.688796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-70e77587-82bf-4afe-9936-b575be8881f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:35.745395 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1335/2645] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:35.755290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:35.756786 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:35.812693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33540a3-7b2d-48a9-bdd6-696bfdcc901d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:35.816424 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95effa3f-60c9-49dd-988e-3fa71cfacfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:35.816998 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95effa3f-60c9-49dd-988e-3fa71cfacfbf service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:35.817280 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95effa3f-60c9-49dd-988e-3fa71cfacfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:35.817551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95effa3f-60c9-49dd-988e-3fa71cfacfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:35.826889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95effa3f-60c9-49dd-988e-3fa71cfacfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:35.828314 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95effa3f-60c9-49dd-988e-3fa71cfacfbf service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:35.838140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1311/2646] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:36.203190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77587-82bf-4afe-9936-b575be8881f9 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:36.204598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-70e77587-82bf-4afe-9936-b575be8881f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:36.217102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e77587-82bf-4afe-9936-b575be8881f9 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:36.222079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:36.222926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:36.223201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:36.223473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] PATH_INFO: `/v3/projects/75e64887386e4680a7e0f147f7b00b1c` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:36.224646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e64887386e4680a7e0f147f7b00b1c)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:36.226884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:36.333978 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e64887386e4680a7e0f147f7b00b1c', 'request_id': 'req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.425179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e64887386e4680a7e0f147f7b00b1c', 'request_id': 'req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.431123 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e64887386e4680a7e0f147f7b00b1c', 'request_id': 'req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.442899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] The token cache is being invalidate because project 75e64887386e4680a7e0f147f7b00b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:36.443180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.443793 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.445314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1336/2647] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:23:36 2022] DELETE /identity/v3/projects/75e64887386e4680a7e0f147f7b00b1c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:36.449874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95effa3f-60c9-49dd-988e-3fa71cfacfbf service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:36.459364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95effa3f-60c9-49dd-988e-3fa71cfacfbf service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:36.512938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:36.513788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:36.514080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:36.514373 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] PATH_INFO: `/v3/users/da40babd334549f881d4fb2183a50f6d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:36.515551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da40babd334549f881d4fb2183a50f6d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:36.517447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:36.695727 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da40babd334549f881d4fb2183a50f6d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.696366 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da40babd334549f881d4fb2183a50f6d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.707721 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da40babd334549f881d4fb2183a50f6d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.708360 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da40babd334549f881d4fb2183a50f6d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.715772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5193ff80-11ac-426a-81d2-095ec86f263c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da40babd334549f881d4fb2183a50f6d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:36.785149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1312/2648] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:23:36 2022] DELETE /identity/v3/users/da40babd334549f881d4fb2183a50f6d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:23:37.232677 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:37.234191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:37.248245 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d87149-152f-4ccd-9bb4-d51c1d99c8b3 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:37.359038 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:37.359890 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.360167 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.360434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] PATH_INFO: `/v3/projects/2714b994f8ce4008a8ee3cd198087c52` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.361596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2714b994f8ce4008a8ee3cd198087c52)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:37.363540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:37.465043 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2714b994f8ce4008a8ee3cd198087c52', 'request_id': 'req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:37.539616 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2714b994f8ce4008a8ee3cd198087c52', 'request_id': 'req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:37.545299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2714b994f8ce4008a8ee3cd198087c52', 'request_id': 'req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:37.555965 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] The token cache is being invalidate because project 2714b994f8ce4008a8ee3cd198087c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:37.556246 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:37.557338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-03a0d51b-cc47-4685-984f-fff5ae8a0bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:37.558911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1337/2649] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:23:37 2022] DELETE /identity/v3/projects/2714b994f8ce4008a8ee3cd198087c52 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:37.563879 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fdee4-946d-4343-92c1-95afa4df9d94 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.564386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fdee4-946d-4343-92c1-95afa4df9d94 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.564495 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fdee4-946d-4343-92c1-95afa4df9d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.582108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-375fdee4-946d-4343-92c1-95afa4df9d94 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:37.583315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-375fdee4-946d-4343-92c1-95afa4df9d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:37.639969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1313/2650] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:37.647472 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dec3a-4dba-45f5-be23-edda3f639d33 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.647828 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dec3a-4dba-45f5-be23-edda3f639d33 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.648106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dec3a-4dba-45f5-be23-edda3f639d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.665559 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-725dec3a-4dba-45f5-be23-edda3f639d33 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:37.666782 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-725dec3a-4dba-45f5-be23-edda3f639d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:37.674670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1338/2651] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:37.678713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fdee4-946d-4343-92c1-95afa4df9d94 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:37.688647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fdee4-946d-4343-92c1-95afa4df9d94 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:37.693172 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2dfbb-38d7-4123-bf84-835064569e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:37.693809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2dfbb-38d7-4123-bf84-835064569e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.694115 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2dfbb-38d7-4123-bf84-835064569e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.694386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2dfbb-38d7-4123-bf84-835064569e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.695099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2dfbb-38d7-4123-bf84-835064569e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:37.695430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2dfbb-38d7-4123-bf84-835064569e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:37.697039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2dfbb-38d7-4123-bf84-835064569e7b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:37.708792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1314/2652] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:23:37.713124 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dec3a-4dba-45f5-be23-edda3f639d33 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:37.722199 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dec3a-4dba-45f5-be23-edda3f639d33 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:37.726827 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b64d8-2e48-4c3f-9968-52018f42d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:37.727461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b64d8-2e48-4c3f-9968-52018f42d3fa admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.727737 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b64d8-2e48-4c3f-9968-52018f42d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.728006 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b64d8-2e48-4c3f-9968-52018f42d3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.728678 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b64d8-2e48-4c3f-9968-52018f42d3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:37.730585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b64d8-2e48-4c3f-9968-52018f42d3fa admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:37.812503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1339/2653] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:23:37 2022] POST /identity/v3/projects => generated 357 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:37.817994 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2dfbb-38d7-4123-bf84-835064569e7b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:37.827801 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2dfbb-38d7-4123-bf84-835064569e7b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:37.881552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1aad-8f6d-476d-b0c2-d824eda9ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:37.882379 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1aad-8f6d-476d-b0c2-d824eda9ea02 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.882772 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1aad-8f6d-476d-b0c2-d824eda9ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.883141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1aad-8f6d-476d-b0c2-d824eda9ea02 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.883946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe1aad-8f6d-476d-b0c2-d824eda9ea02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:37.886112 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe1aad-8f6d-476d-b0c2-d824eda9ea02 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:37.944996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1315/2654] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:23:37 2022] POST /identity/v3/users => generated 279 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:37.949186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b64d8-2e48-4c3f-9968-52018f42d3fa admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:37.959693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b64d8-2e48-4c3f-9968-52018f42d3fa admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:37.964452 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039e61-a4e0-4b2c-b1a2-cdfb98d5d527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:37.965099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039e61-a4e0-4b2c-b1a2-cdfb98d5d527 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.965381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039e61-a4e0-4b2c-b1a2-cdfb98d5d527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.965654 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039e61-a4e0-4b2c-b1a2-cdfb98d5d527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.966411 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18039e61-a4e0-4b2c-b1a2-cdfb98d5d527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:37.967995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18039e61-a4e0-4b2c-b1a2-cdfb98d5d527 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:37.977980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1340/2655] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:37.982301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1aad-8f6d-476d-b0c2-d824eda9ea02 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:37.992209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1aad-8f6d-476d-b0c2-d824eda9ea02 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:37.997818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866e31e-82c7-40e3-9b5b-7db9ae1eb468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:37.998501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866e31e-82c7-40e3-9b5b-7db9ae1eb468 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:37.998780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866e31e-82c7-40e3-9b5b-7db9ae1eb468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:37.999084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866e31e-82c7-40e3-9b5b-7db9ae1eb468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:37.999810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866e31e-82c7-40e3-9b5b-7db9ae1eb468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.001406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866e31e-82c7-40e3-9b5b-7db9ae1eb468 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.011510 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1316/2656] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:38.015596 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039e61-a4e0-4b2c-b1a2-cdfb98d5d527 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.025203 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039e61-a4e0-4b2c-b1a2-cdfb98d5d527 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.029774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999a18-a452-434f-b6f0-aa8d1112453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.030666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999a18-a452-434f-b6f0-aa8d1112453f admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.030944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999a18-a452-434f-b6f0-aa8d1112453f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.031214 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999a18-a452-434f-b6f0-aa8d1112453f admin admin] PATH_INFO: `/v3/projects/f3e2bf7c01c846d2ad0c91e8a7e72799/users/c957c869164949e7ad90d6948a329f1e/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.045299 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3999a18-a452-434f-b6f0-aa8d1112453f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e2bf7c01c846d2ad0c91e8a7e72799, user_id=c957c869164949e7ad90d6948a329f1e, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.047988 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3999a18-a452-434f-b6f0-aa8d1112453f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.128154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1341/2657] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:38 2022] PUT /identity/v3/projects/f3e2bf7c01c846d2ad0c91e8a7e72799/users/c957c869164949e7ad90d6948a329f1e/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:38.138619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5bf2f-acba-48d4-a47e-b224adff3546 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.138911 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5bf2f-acba-48d4-a47e-b224adff3546 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.139193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5bf2f-acba-48d4-a47e-b224adff3546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.165685 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-78e5bf2f-acba-48d4-a47e-b224adff3546 None None] MFA Rules not processed for user `c957c869164949e7ad90d6948a329f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:38.169441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-78e5bf2f-acba-48d4-a47e-b224adff3546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:38.231660 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1317/2658] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:38.236140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999a18-a452-434f-b6f0-aa8d1112453f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.296015 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999a18-a452-434f-b6f0-aa8d1112453f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.300761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac30452-3175-4c1a-b0f9-b5b4eaf74cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.301417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac30452-3175-4c1a-b0f9-b5b4eaf74cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.301701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac30452-3175-4c1a-b0f9-b5b4eaf74cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.301979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac30452-3175-4c1a-b0f9-b5b4eaf74cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.302696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac30452-3175-4c1a-b0f9-b5b4eaf74cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.304597 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac30452-3175-4c1a-b0f9-b5b4eaf74cb2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.368575 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1342/2659] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:23:38 2022] POST /identity/v3/projects => generated 357 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:38.372548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5bf2f-acba-48d4-a47e-b224adff3546 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.385099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5bf2f-acba-48d4-a47e-b224adff3546 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.438216 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ef58b-0cb8-46bc-b2a8-4d5de5a127de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.438873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ef58b-0cb8-46bc-b2a8-4d5de5a127de admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.439152 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ef58b-0cb8-46bc-b2a8-4d5de5a127de admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.439423 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ef58b-0cb8-46bc-b2a8-4d5de5a127de admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.440100 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ef58b-0cb8-46bc-b2a8-4d5de5a127de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.441992 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ef58b-0cb8-46bc-b2a8-4d5de5a127de admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.510073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1318/2660] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:23:38 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:38.514156 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac30452-3175-4c1a-b0f9-b5b4eaf74cb2 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.524288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac30452-3175-4c1a-b0f9-b5b4eaf74cb2 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.529476 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f43e7-2fae-467c-a3c6-6d14327ae672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.530249 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f43e7-2fae-467c-a3c6-6d14327ae672 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.534421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f43e7-2fae-467c-a3c6-6d14327ae672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.534421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f43e7-2fae-467c-a3c6-6d14327ae672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.534421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f43e7-2fae-467c-a3c6-6d14327ae672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.534421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f43e7-2fae-467c-a3c6-6d14327ae672 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.545908 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1343/2661] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:38.550040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ef58b-0cb8-46bc-b2a8-4d5de5a127de admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.559973 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ef58b-0cb8-46bc-b2a8-4d5de5a127de admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.564592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bf247-9161-4ddd-a854-98f5283b29ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.565580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bf247-9161-4ddd-a854-98f5283b29ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.565859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bf247-9161-4ddd-a854-98f5283b29ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.566155 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bf247-9161-4ddd-a854-98f5283b29ca admin admin] PATH_INFO: `/v3/projects/89ebbdfa60ae42c1a8f755983c99000a/users/2b323a5b6ae44e329d290ffe0ac58357/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.580596 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bf247-9161-4ddd-a854-98f5283b29ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ebbdfa60ae42c1a8f755983c99000a, user_id=2b323a5b6ae44e329d290ffe0ac58357, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.583267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bf247-9161-4ddd-a854-98f5283b29ca admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.630046 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1319/2662] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:38 2022] PUT /identity/v3/projects/89ebbdfa60ae42c1a8f755983c99000a/users/2b323a5b6ae44e329d290ffe0ac58357/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:38.633781 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f43e7-2fae-467c-a3c6-6d14327ae672 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.644216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f43e7-2fae-467c-a3c6-6d14327ae672 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.696261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce55d6e-2ab4-49c8-a112-b67245220e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.696913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce55d6e-2ab4-49c8-a112-b67245220e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.697190 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce55d6e-2ab4-49c8-a112-b67245220e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.697948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce55d6e-2ab4-49c8-a112-b67245220e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.698692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce55d6e-2ab4-49c8-a112-b67245220e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.700275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce55d6e-2ab4-49c8-a112-b67245220e30 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.709681 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1344/2663] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:38.714250 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bf247-9161-4ddd-a854-98f5283b29ca admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.724088 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bf247-9161-4ddd-a854-98f5283b29ca admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.728590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e0b9c-76a1-4ee5-8f31-c4924a2cb27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.729449 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e0b9c-76a1-4ee5-8f31-c4924a2cb27f admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.729725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e0b9c-76a1-4ee5-8f31-c4924a2cb27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.729995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e0b9c-76a1-4ee5-8f31-c4924a2cb27f admin admin] PATH_INFO: `/v3/projects/89ebbdfa60ae42c1a8f755983c99000a/users/2b323a5b6ae44e329d290ffe0ac58357/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.731935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e0b9c-76a1-4ee5-8f31-c4924a2cb27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ebbdfa60ae42c1a8f755983c99000a, user_id=2b323a5b6ae44e329d290ffe0ac58357, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.734574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e0b9c-76a1-4ee5-8f31-c4924a2cb27f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.744222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1320/2664] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:38 2022] PUT /identity/v3/projects/89ebbdfa60ae42c1a8f755983c99000a/users/2b323a5b6ae44e329d290ffe0ac58357/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:38.755079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309be8f-fe68-413e-b8f8-0be012f31a72 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.755371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309be8f-fe68-413e-b8f8-0be012f31a72 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.755649 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309be8f-fe68-413e-b8f8-0be012f31a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.782505 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-0309be8f-fe68-413e-b8f8-0be012f31a72 None None] MFA Rules not processed for user `2b323a5b6ae44e329d290ffe0ac58357`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:38.783634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-0309be8f-fe68-413e-b8f8-0be012f31a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:38.847332 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1345/2665] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:38 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:38.858378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e0b9c-76a1-4ee5-8f31-c4924a2cb27f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:38.860073 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5d5e0b9c-76a1-4ee5-8f31-c4924a2cb27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:38.915655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e0b9c-76a1-4ee5-8f31-c4924a2cb27f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:38.919268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac7054-841b-4783-83a0-af6a06f69fd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:38.919900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7054-841b-4783-83a0-af6a06f69fd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:38.920181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7054-841b-4783-83a0-af6a06f69fd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:38.920454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7054-841b-4783-83a0-af6a06f69fd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:38.929279 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac7054-841b-4783-83a0-af6a06f69fd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:38.930736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac7054-841b-4783-83a0-af6a06f69fd8 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:38.940446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1321/2666] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:38 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:39.111740 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309be8f-fe68-413e-b8f8-0be012f31a72 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:39.121805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309be8f-fe68-413e-b8f8-0be012f31a72 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:39.125358 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b4e83-b0ae-4c39-80ac-93d12360b22b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:39.125985 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b4e83-b0ae-4c39-80ac-93d12360b22b service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:39.126291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b4e83-b0ae-4c39-80ac-93d12360b22b service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:39.126563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b4e83-b0ae-4c39-80ac-93d12360b22b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:39.179427 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b4e83-b0ae-4c39-80ac-93d12360b22b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:39.180851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b4e83-b0ae-4c39-80ac-93d12360b22b service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:39.189959 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1346/2667] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:39 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:23:57.237298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac7054-841b-4783-83a0-af6a06f69fd8 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:57.295966 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac7054-841b-4783-83a0-af6a06f69fd8 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:57.300416 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:57.301267 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:57.301549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:57.301823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] PATH_INFO: `/v3/users/c957c869164949e7ad90d6948a329f1e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:57.303018 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c957c869164949e7ad90d6948a329f1e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:57.304912 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:57.481197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c957c869164949e7ad90d6948a329f1e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:57.481769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c957c869164949e7ad90d6948a329f1e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:57.492841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c957c869164949e7ad90d6948a329f1e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:57.493456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c957c869164949e7ad90d6948a329f1e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:57.500040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c957c869164949e7ad90d6948a329f1e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:57.582646 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1322/2668] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:23:57 2022] DELETE /identity/v3/users/c957c869164949e7ad90d6948a329f1e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:57.587453 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8020-5577-4936-b086-efcbe09de690 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:57.588599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8020-5577-4936-b086-efcbe09de690 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:57.588599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8020-5577-4936-b086-efcbe09de690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:57.605051 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-bf4c8020-5577-4936-b086-efcbe09de690 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:57.606276 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bf4c8020-5577-4936-b086-efcbe09de690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:57.660715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1347/2669] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:57.670193 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:57.671592 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:57.726620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96433c-5d21-4edc-b149-d94882b5bd6a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:57.730274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114fd92-9e06-4e22-83a3-479b4193a4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:57.730918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114fd92-9e06-4e22-83a3-479b4193a4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:57.731254 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114fd92-9e06-4e22-83a3-479b4193a4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:57.731478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114fd92-9e06-4e22-83a3-479b4193a4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:57.740410 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114fd92-9e06-4e22-83a3-479b4193a4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:57.741917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114fd92-9e06-4e22-83a3-479b4193a4b8 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:57.763126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1323/2670] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:23:58.133128 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c8020-5577-4936-b086-efcbe09de690 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:58.134581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-bf4c8020-5577-4936-b086-efcbe09de690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:58.147095 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c8020-5577-4936-b086-efcbe09de690 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:58.154774 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:58.156467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:58.156976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:58.157343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] PATH_INFO: `/v3/projects/f3e2bf7c01c846d2ad0c91e8a7e72799` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:58.158659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e2bf7c01c846d2ad0c91e8a7e72799)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:58.160576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:58.262699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e2bf7c01c846d2ad0c91e8a7e72799', 'request_id': 'req-f136562e-0ca7-4329-9d35-3a350143f8d3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.354366 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e2bf7c01c846d2ad0c91e8a7e72799', 'request_id': 'req-f136562e-0ca7-4329-9d35-3a350143f8d3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.361098 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e2bf7c01c846d2ad0c91e8a7e72799', 'request_id': 'req-f136562e-0ca7-4329-9d35-3a350143f8d3'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.371250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] The token cache is being invalidate because project f3e2bf7c01c846d2ad0c91e8a7e72799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:58.371537 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.372158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.373728 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1348/2671] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:23:58 2022] DELETE /identity/v3/projects/f3e2bf7c01c846d2ad0c91e8a7e72799 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:58.377674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114fd92-9e06-4e22-83a3-479b4193a4b8 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:58.387784 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114fd92-9e06-4e22-83a3-479b4193a4b8 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:58.441841 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:58.442733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:58.443013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:58.443289 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] PATH_INFO: `/v3/users/2b323a5b6ae44e329d290ffe0ac58357` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:58.444454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b323a5b6ae44e329d290ffe0ac58357)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:58.446378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:58.624552 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b323a5b6ae44e329d290ffe0ac58357'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.625137 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b323a5b6ae44e329d290ffe0ac58357'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.636641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b323a5b6ae44e329d290ffe0ac58357'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.637274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b323a5b6ae44e329d290ffe0ac58357'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.644231 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2bc091fe-c73b-49d5-ae54-e313e1a93f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b323a5b6ae44e329d290ffe0ac58357'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:58.708277 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1324/2672] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:23:58 2022] DELETE /identity/v3/users/2b323a5b6ae44e329d290ffe0ac58357 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:59.122866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.124335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:59.141595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136562e-0ca7-4329-9d35-3a350143f8d3 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.192290 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.193103 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.193432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.193751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] PATH_INFO: `/v3/projects/89ebbdfa60ae42c1a8f755983c99000a` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.194941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ebbdfa60ae42c1a8f755983c99000a)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.198620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.331091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ebbdfa60ae42c1a8f755983c99000a', 'request_id': 'req-9a45f1b9-8d7c-46e9-b154-1fc915538441'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:59.399848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ebbdfa60ae42c1a8f755983c99000a', 'request_id': 'req-9a45f1b9-8d7c-46e9-b154-1fc915538441'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:59.405930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ebbdfa60ae42c1a8f755983c99000a', 'request_id': 'req-9a45f1b9-8d7c-46e9-b154-1fc915538441'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:59.417315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] The token cache is being invalidate because project 89ebbdfa60ae42c1a8f755983c99000a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:23:59.417595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:59.418242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9a45f1b9-8d7c-46e9-b154-1fc915538441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:23:59.419775 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1349/2673] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:23:59 2022] DELETE /identity/v3/projects/89ebbdfa60ae42c1a8f755983c99000a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:23:59.424682 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe5976-660e-46bc-b9f9-5b48867bab1c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.425180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe5976-660e-46bc-b9f9-5b48867bab1c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.425295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe5976-660e-46bc-b9f9-5b48867bab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.444832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fafe5976-660e-46bc-b9f9-5b48867bab1c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:59.445986 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fafe5976-660e-46bc-b9f9-5b48867bab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:59.514618 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1325/2674] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:59.522401 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd05b6-5fc3-4f16-9460-2cae10fdc13b None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.522687 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd05b6-5fc3-4f16-9460-2cae10fdc13b None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.522961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd05b6-5fc3-4f16-9460-2cae10fdc13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.541005 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-09bd05b6-5fc3-4f16-9460-2cae10fdc13b None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:23:59.542215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-09bd05b6-5fc3-4f16-9460-2cae10fdc13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:23:59.550121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1350/2675] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:23:59.554114 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe5976-660e-46bc-b9f9-5b48867bab1c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.563436 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe5976-660e-46bc-b9f9-5b48867bab1c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.567978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce6ba3-2dd2-4bff-9886-41ef4a1845d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.568620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce6ba3-2dd2-4bff-9886-41ef4a1845d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.568902 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce6ba3-2dd2-4bff-9886-41ef4a1845d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.569183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce6ba3-2dd2-4bff-9886-41ef4a1845d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.569900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce6ba3-2dd2-4bff-9886-41ef4a1845d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:23:59.570243 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce6ba3-2dd2-4bff-9886-41ef4a1845d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.571834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce6ba3-2dd2-4bff-9886-41ef4a1845d0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.583604 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1326/2676] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:23:59.587667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd05b6-5fc3-4f16-9460-2cae10fdc13b None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.597060 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd05b6-5fc3-4f16-9460-2cae10fdc13b None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.601614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237320c1-34c3-4c0f-89a2-08671491066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.602286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237320c1-34c3-4c0f-89a2-08671491066f admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.602565 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237320c1-34c3-4c0f-89a2-08671491066f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.602862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237320c1-34c3-4c0f-89a2-08671491066f admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.603543 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237320c1-34c3-4c0f-89a2-08671491066f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.605413 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237320c1-34c3-4c0f-89a2-08671491066f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.721739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1351/2677] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:23:59 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:23:59.725563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce6ba3-2dd2-4bff-9886-41ef4a1845d0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.735372 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce6ba3-2dd2-4bff-9886-41ef4a1845d0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.792051 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedf0ca-3801-4d82-b4ed-9f21df3f18d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.792725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedf0ca-3801-4d82-b4ed-9f21df3f18d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.793009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedf0ca-3801-4d82-b4ed-9f21df3f18d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.793284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedf0ca-3801-4d82-b4ed-9f21df3f18d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.793984 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedf0ca-3801-4d82-b4ed-9f21df3f18d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.795938 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedf0ca-3801-4d82-b4ed-9f21df3f18d4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.868364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1327/2678] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:23:59 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:23:59.872958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237320c1-34c3-4c0f-89a2-08671491066f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.882857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237320c1-34c3-4c0f-89a2-08671491066f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.888418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243f22-fb70-4c96-b6bf-08c0edc9da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.889056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243f22-fb70-4c96-b6bf-08c0edc9da15 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.889339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243f22-fb70-4c96-b6bf-08c0edc9da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.889609 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243f22-fb70-4c96-b6bf-08c0edc9da15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.890355 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243f22-fb70-4c96-b6bf-08c0edc9da15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.895955 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243f22-fb70-4c96-b6bf-08c0edc9da15 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.902278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1352/2679] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:23:59.906090 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedf0ca-3801-4d82-b4ed-9f21df3f18d4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.915956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedf0ca-3801-4d82-b4ed-9f21df3f18d4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.921052 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93b333-bed9-48f3-a463-f7e5ac5c506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.921689 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93b333-bed9-48f3-a463-f7e5ac5c506f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.921969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93b333-bed9-48f3-a463-f7e5ac5c506f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.922272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93b333-bed9-48f3-a463-f7e5ac5c506f admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.922983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93b333-bed9-48f3-a463-f7e5ac5c506f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.924557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93b333-bed9-48f3-a463-f7e5ac5c506f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:23:59.934068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1328/2680] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:23:59.937963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243f22-fb70-4c96-b6bf-08c0edc9da15 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:23:59.947663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243f22-fb70-4c96-b6bf-08c0edc9da15 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:23:59.952231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9a760-33e5-4d21-9607-472f7bc46d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:23:59.953093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a760-33e5-4d21-9607-472f7bc46d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:23:59.953373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a760-33e5-4d21-9607-472f7bc46d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:23:59.953647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a760-33e5-4d21-9607-472f7bc46d40 admin admin] PATH_INFO: `/v3/projects/d303caa33ab64cc29f9ccc376f40b94f/users/ebbb0930547d47d0a18262a4e637c9e9/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:23:59.968474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9a760-33e5-4d21-9607-472f7bc46d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d303caa33ab64cc29f9ccc376f40b94f, user_id=ebbb0930547d47d0a18262a4e637c9e9, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:23:59.971176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9a760-33e5-4d21-9607-472f7bc46d40 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:00.034255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1353/2681] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:23:59 2022] PUT /identity/v3/projects/d303caa33ab64cc29f9ccc376f40b94f/users/ebbb0930547d47d0a18262a4e637c9e9/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:00.046256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884dbb1-d4a6-4f43-af65-3f59bfc8265f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:00.046990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884dbb1-d4a6-4f43-af65-3f59bfc8265f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:00.046990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884dbb1-d4a6-4f43-af65-3f59bfc8265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:00.072421 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b884dbb1-d4a6-4f43-af65-3f59bfc8265f None None] MFA Rules not processed for user `ebbb0930547d47d0a18262a4e637c9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:00.073617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b884dbb1-d4a6-4f43-af65-3f59bfc8265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:00.136362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1329/2682] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:00.140868 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9a760-33e5-4d21-9607-472f7bc46d40 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:00.199256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9a760-33e5-4d21-9607-472f7bc46d40 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:00.203967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc7306-f2be-4c66-97b1-eeacac1a88ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:00.204625 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc7306-f2be-4c66-97b1-eeacac1a88ce admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:00.204909 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc7306-f2be-4c66-97b1-eeacac1a88ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:00.205187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc7306-f2be-4c66-97b1-eeacac1a88ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:00.205867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc7306-f2be-4c66-97b1-eeacac1a88ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:00.208063 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc7306-f2be-4c66-97b1-eeacac1a88ce admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:00.269912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1354/2683] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:24:00 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:00.274017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884dbb1-d4a6-4f43-af65-3f59bfc8265f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:00.284957 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884dbb1-d4a6-4f43-af65-3f59bfc8265f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:00.339692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5f169-e17f-45dc-aaa9-b469c35d0ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:00.340355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5f169-e17f-45dc-aaa9-b469c35d0ece admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:00.340641 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5f169-e17f-45dc-aaa9-b469c35d0ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:00.340918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5f169-e17f-45dc-aaa9-b469c35d0ece admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:00.341591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5f169-e17f-45dc-aaa9-b469c35d0ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:00.343535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5f169-e17f-45dc-aaa9-b469c35d0ece admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:00.406510 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1330/2684] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:24:00 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:24:00.410437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc7306-f2be-4c66-97b1-eeacac1a88ce admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:00.420573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc7306-f2be-4c66-97b1-eeacac1a88ce admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:00.425215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d161b2-882e-4b6f-9dd3-652406cf19e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:00.425877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d161b2-882e-4b6f-9dd3-652406cf19e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:00.426195 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d161b2-882e-4b6f-9dd3-652406cf19e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:00.426475 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d161b2-882e-4b6f-9dd3-652406cf19e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:00.427201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d161b2-882e-4b6f-9dd3-652406cf19e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:00.428789 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d161b2-882e-4b6f-9dd3-652406cf19e6 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:00.439012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1355/2685] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:00.443106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5f169-e17f-45dc-aaa9-b469c35d0ece admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:00.453284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5f169-e17f-45dc-aaa9-b469c35d0ece admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:00.458246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009ef49-68d2-4cab-a1ef-8443dda0e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:00.462247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009ef49-68d2-4cab-a1ef-8443dda0e85b admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:00.462247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009ef49-68d2-4cab-a1ef-8443dda0e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:00.462247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009ef49-68d2-4cab-a1ef-8443dda0e85b admin admin] PATH_INFO: `/v3/projects/ffbfa9e0f15249dd9db07530b076b7f3/users/3807a75ef514420e930422a9f9e71187/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:00.474736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009ef49-68d2-4cab-a1ef-8443dda0e85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbfa9e0f15249dd9db07530b076b7f3, user_id=3807a75ef514420e930422a9f9e71187, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:00.477469 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009ef49-68d2-4cab-a1ef-8443dda0e85b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:00.542623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1331/2686] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:24:00 2022] PUT /identity/v3/projects/ffbfa9e0f15249dd9db07530b076b7f3/users/3807a75ef514420e930422a9f9e71187/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:00.546464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d161b2-882e-4b6f-9dd3-652406cf19e6 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:00.557327 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d161b2-882e-4b6f-9dd3-652406cf19e6 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:00.611050 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d4601-0cfc-4071-950b-a9cb5e1eb28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:00.611706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4601-0cfc-4071-950b-a9cb5e1eb28f admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:00.611986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4601-0cfc-4071-950b-a9cb5e1eb28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:00.612258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4601-0cfc-4071-950b-a9cb5e1eb28f admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:00.612976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d4601-0cfc-4071-950b-a9cb5e1eb28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:00.614599 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d4601-0cfc-4071-950b-a9cb5e1eb28f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:00.624330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1356/2687] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:00.628506 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009ef49-68d2-4cab-a1ef-8443dda0e85b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:00.639036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009ef49-68d2-4cab-a1ef-8443dda0e85b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:00.643619 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833acdc-ab34-4816-aafd-96b52a89b90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:00.644486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833acdc-ab34-4816-aafd-96b52a89b90a admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:00.644766 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833acdc-ab34-4816-aafd-96b52a89b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:00.645041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833acdc-ab34-4816-aafd-96b52a89b90a admin admin] PATH_INFO: `/v3/projects/ffbfa9e0f15249dd9db07530b076b7f3/users/3807a75ef514420e930422a9f9e71187/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:00.647024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833acdc-ab34-4816-aafd-96b52a89b90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbfa9e0f15249dd9db07530b076b7f3, user_id=3807a75ef514420e930422a9f9e71187, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:00.649623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833acdc-ab34-4816-aafd-96b52a89b90a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:00.659389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1332/2688] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:24:00 2022] PUT /identity/v3/projects/ffbfa9e0f15249dd9db07530b076b7f3/users/3807a75ef514420e930422a9f9e71187/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:00.669297 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7236-afe5-482b-86ab-c7b460715d15 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:00.669584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7236-afe5-482b-86ab-c7b460715d15 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:00.669859 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed7236-afe5-482b-86ab-c7b460715d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:00.695566 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3fed7236-afe5-482b-86ab-c7b460715d15 None None] MFA Rules not processed for user `3807a75ef514420e930422a9f9e71187`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:00.696763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3fed7236-afe5-482b-86ab-c7b460715d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:00.760947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1357/2689] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:00.771559 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833acdc-ab34-4816-aafd-96b52a89b90a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:00.773270 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b833acdc-ab34-4816-aafd-96b52a89b90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:00.830149 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833acdc-ab34-4816-aafd-96b52a89b90a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:00.834477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827db44-1551-45a8-83ca-7602b9972a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:00.834688 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827db44-1551-45a8-83ca-7602b9972a9e service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:00.834965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827db44-1551-45a8-83ca-7602b9972a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:00.835237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827db44-1551-45a8-83ca-7602b9972a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:00.843925 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827db44-1551-45a8-83ca-7602b9972a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:00.845476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827db44-1551-45a8-83ca-7602b9972a9e service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:00.854526 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1333/2690] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:24:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:01.340546 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7236-afe5-482b-86ab-c7b460715d15 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:01.399947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed7236-afe5-482b-86ab-c7b460715d15 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:01.404461 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:01.405354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:01.405633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:01.406087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] PATH_INFO: `/v3/users/ebbb0930547d47d0a18262a4e637c9e9` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:01.407414 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebbb0930547d47d0a18262a4e637c9e9)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:01.409989 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:01.601196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebbb0930547d47d0a18262a4e637c9e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:01.601778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebbb0930547d47d0a18262a4e637c9e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:01.602398 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebbb0930547d47d0a18262a4e637c9e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:01.613886 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebbb0930547d47d0a18262a4e637c9e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:01.620935 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebbb0930547d47d0a18262a4e637c9e9'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:01.713628 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1358/2691] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:24:01 2022] DELETE /identity/v3/users/ebbb0930547d47d0a18262a4e637c9e9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:01.718210 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478e788-ea84-4fce-bd20-e695818a9401 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:01.718691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478e788-ea84-4fce-bd20-e695818a9401 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:01.718824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478e788-ea84-4fce-bd20-e695818a9401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:01.735750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5478e788-ea84-4fce-bd20-e695818a9401 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:01.736921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5478e788-ea84-4fce-bd20-e695818a9401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:01.793852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1334/2692] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:01.803258 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:01.804605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:01.863960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f7fe-5597-4fc4-918c-c6e7725302fe admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:01.867644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313d050-05b0-4952-ac41-69f153a10ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:01.868278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313d050-05b0-4952-ac41-69f153a10ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:01.868558 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313d050-05b0-4952-ac41-69f153a10ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:01.868915 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313d050-05b0-4952-ac41-69f153a10ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:01.878168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313d050-05b0-4952-ac41-69f153a10ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:01.879582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313d050-05b0-4952-ac41-69f153a10ff4 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:01.888748 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1359/2693] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:02.276080 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478e788-ea84-4fce-bd20-e695818a9401 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:02.277482 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5478e788-ea84-4fce-bd20-e695818a9401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:02.289533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478e788-ea84-4fce-bd20-e695818a9401 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:02.295054 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:02.295930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:02.296301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:02.296524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] PATH_INFO: `/v3/projects/d303caa33ab64cc29f9ccc376f40b94f` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:02.297724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d303caa33ab64cc29f9ccc376f40b94f)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:02.299674 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:02.401009 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd303caa33ab64cc29f9ccc376f40b94f', 'request_id': 'req-7c992295-6e66-4190-b8dd-0bffb8139ab0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.407363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd303caa33ab64cc29f9ccc376f40b94f', 'request_id': 'req-7c992295-6e66-4190-b8dd-0bffb8139ab0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.412933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd303caa33ab64cc29f9ccc376f40b94f', 'request_id': 'req-7c992295-6e66-4190-b8dd-0bffb8139ab0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.513636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] The token cache is being invalidate because project d303caa33ab64cc29f9ccc376f40b94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:24:02.513921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.514573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.516106 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1335/2694] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:24:02 2022] DELETE /identity/v3/projects/d303caa33ab64cc29f9ccc376f40b94f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:02.520055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313d050-05b0-4952-ac41-69f153a10ff4 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:02.530115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313d050-05b0-4952-ac41-69f153a10ff4 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:02.584956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:02.585808 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:02.586115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:02.586419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] PATH_INFO: `/v3/users/3807a75ef514420e930422a9f9e71187` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:02.588248 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3807a75ef514420e930422a9f9e71187)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:02.590183 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:02.761498 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3807a75ef514420e930422a9f9e71187'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.762085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3807a75ef514420e930422a9f9e71187'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.762727 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3807a75ef514420e930422a9f9e71187'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.773783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3807a75ef514420e930422a9f9e71187'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.781008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-043f68e7-34da-4f1d-8ce9-d90661614068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3807a75ef514420e930422a9f9e71187'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:02.850406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1360/2695] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:24:02 2022] DELETE /identity/v3/users/3807a75ef514420e930422a9f9e71187 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:03.224398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:03.225875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:03.239057 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992295-6e66-4190-b8dd-0bffb8139ab0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:03.294799 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:03.295710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:03.295941 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:03.296214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] PATH_INFO: `/v3/projects/ffbfa9e0f15249dd9db07530b076b7f3` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:03.297380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbfa9e0f15249dd9db07530b076b7f3)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:03.299315 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:03.411653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbfa9e0f15249dd9db07530b076b7f3', 'request_id': 'req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:03.420003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbfa9e0f15249dd9db07530b076b7f3', 'request_id': 'req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:03.424050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbfa9e0f15249dd9db07530b076b7f3', 'request_id': 'req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:03.501635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] The token cache is being invalidate because project ffbfa9e0f15249dd9db07530b076b7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:24:03.501955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:03.502620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cd00e87a-5983-4e47-ba98-1c8f43aa46c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:03.504150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1336/2696] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:24:03 2022] DELETE /identity/v3/projects/ffbfa9e0f15249dd9db07530b076b7f3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:03.508951 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121c06d-ca3e-4a3c-98be-d63208504f53 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:03.509751 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121c06d-ca3e-4a3c-98be-d63208504f53 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:03.510031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121c06d-ca3e-4a3c-98be-d63208504f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:03.527614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f121c06d-ca3e-4a3c-98be-d63208504f53 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:03.528791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f121c06d-ca3e-4a3c-98be-d63208504f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:03.584364 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1361/2697] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:03.592662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc45ab-bc65-4db9-83e6-5f7b553a7a37 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:03.592951 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc45ab-bc65-4db9-83e6-5f7b553a7a37 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:03.593227 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc45ab-bc65-4db9-83e6-5f7b553a7a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:03.611074 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0bfc45ab-bc65-4db9-83e6-5f7b553a7a37 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:03.612248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0bfc45ab-bc65-4db9-83e6-5f7b553a7a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:03.620908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1337/2698] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:03.624794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121c06d-ca3e-4a3c-98be-d63208504f53 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:03.634037 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121c06d-ca3e-4a3c-98be-d63208504f53 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:03.639320 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be870196-4ce3-4e87-8eb0-953f87672f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:03.640011 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be870196-4ce3-4e87-8eb0-953f87672f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:03.640291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be870196-4ce3-4e87-8eb0-953f87672f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:03.640564 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be870196-4ce3-4e87-8eb0-953f87672f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:03.641286 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be870196-4ce3-4e87-8eb0-953f87672f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:24:03.641588 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be870196-4ce3-4e87-8eb0-953f87672f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:03.643232 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be870196-4ce3-4e87-8eb0-953f87672f4a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:03.654205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1362/2699] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:24:03.658127 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc45ab-bc65-4db9-83e6-5f7b553a7a37 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:03.667209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc45ab-bc65-4db9-83e6-5f7b553a7a37 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:03.671822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f86d3a-fa0e-4200-bfa2-88ad2ce0e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:03.672457 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f86d3a-fa0e-4200-bfa2-88ad2ce0e484 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:03.672742 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f86d3a-fa0e-4200-bfa2-88ad2ce0e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:03.673019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f86d3a-fa0e-4200-bfa2-88ad2ce0e484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:03.673711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f86d3a-fa0e-4200-bfa2-88ad2ce0e484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:03.675629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f86d3a-fa0e-4200-bfa2-88ad2ce0e484 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:03.762632 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1338/2700] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:24:03 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:24:03.766518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be870196-4ce3-4e87-8eb0-953f87672f4a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:03.776375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be870196-4ce3-4e87-8eb0-953f87672f4a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:03.828866 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852560a-8606-4ea3-afdc-30d80af5989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:03.829520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852560a-8606-4ea3-afdc-30d80af5989e admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:03.829800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852560a-8606-4ea3-afdc-30d80af5989e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:03.830088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852560a-8606-4ea3-afdc-30d80af5989e admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:03.830784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852560a-8606-4ea3-afdc-30d80af5989e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:03.832919 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852560a-8606-4ea3-afdc-30d80af5989e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:03.902563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1363/2701] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:24:03 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:24:03.906516 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f86d3a-fa0e-4200-bfa2-88ad2ce0e484 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:03.916364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f86d3a-fa0e-4200-bfa2-88ad2ce0e484 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:03.920887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdada4-d13f-4bf9-86e7-f3a6c2f300ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:03.921529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdada4-d13f-4bf9-86e7-f3a6c2f300ee admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:03.921807 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdada4-d13f-4bf9-86e7-f3a6c2f300ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:03.922098 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdada4-d13f-4bf9-86e7-f3a6c2f300ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:03.922815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdada4-d13f-4bf9-86e7-f3a6c2f300ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:03.924394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdada4-d13f-4bf9-86e7-f3a6c2f300ee admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:03.934817 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1339/2702] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:03.938509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852560a-8606-4ea3-afdc-30d80af5989e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:03.948805 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852560a-8606-4ea3-afdc-30d80af5989e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:03.953345 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe19abc-4151-46df-ab0e-8ea73dfec48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:03.953982 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19abc-4151-46df-ab0e-8ea73dfec48e admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:03.954296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19abc-4151-46df-ab0e-8ea73dfec48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:03.954572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19abc-4151-46df-ab0e-8ea73dfec48e admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:03.955284 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe19abc-4151-46df-ab0e-8ea73dfec48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:03.956862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe19abc-4151-46df-ab0e-8ea73dfec48e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:03.966813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1364/2703] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:03.970624 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdada4-d13f-4bf9-86e7-f3a6c2f300ee admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:03.980802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdada4-d13f-4bf9-86e7-f3a6c2f300ee admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:03.985363 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e9754-d0c7-4d3f-b59d-a1a6653a8c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:03.986258 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e9754-d0c7-4d3f-b59d-a1a6653a8c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:03.986534 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e9754-d0c7-4d3f-b59d-a1a6653a8c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:03.986805 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e9754-d0c7-4d3f-b59d-a1a6653a8c63 admin admin] PATH_INFO: `/v3/projects/1f9c284dcb9f45048ef6b5a9afea255e/users/0039a8d9050b4f14a88014e785647d21/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:04.001438 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e9754-d0c7-4d3f-b59d-a1a6653a8c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9c284dcb9f45048ef6b5a9afea255e, user_id=0039a8d9050b4f14a88014e785647d21, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:04.004092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e9754-d0c7-4d3f-b59d-a1a6653a8c63 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:04.085871 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1340/2704] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:24:03 2022] PUT /identity/v3/projects/1f9c284dcb9f45048ef6b5a9afea255e/users/0039a8d9050b4f14a88014e785647d21/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:04.097052 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb404f-53d5-4f78-b61b-dfa23e055e93 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:04.097341 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb404f-53d5-4f78-b61b-dfa23e055e93 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:04.097731 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb404f-53d5-4f78-b61b-dfa23e055e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:04.124151 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-6acb404f-53d5-4f78-b61b-dfa23e055e93 None None] MFA Rules not processed for user `0039a8d9050b4f14a88014e785647d21`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:04.125325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6acb404f-53d5-4f78-b61b-dfa23e055e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:04.186228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1365/2705] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:04.196996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e9754-d0c7-4d3f-b59d-a1a6653a8c63 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:04.198707 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-915e9754-d0c7-4d3f-b59d-a1a6653a8c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:04.253274 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e9754-d0c7-4d3f-b59d-a1a6653a8c63 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:04.256927 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636192b-cafe-40f1-b67f-fae2f614aae4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9237b353da546989b399ee9702d1bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:04.257561 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636192b-cafe-40f1-b67f-fae2f614aae4 service glance] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:04.257839 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636192b-cafe-40f1-b67f-fae2f614aae4 service glance] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:04.258141 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636192b-cafe-40f1-b67f-fae2f614aae4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:04.266147 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636192b-cafe-40f1-b67f-fae2f614aae4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:04.267558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636192b-cafe-40f1-b67f-fae2f614aae4 service glance] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:04.276001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1341/2706] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:24:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:15.273597 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb404f-53d5-4f78-b61b-dfa23e055e93 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:15.275117 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6acb404f-53d5-4f78-b61b-dfa23e055e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:15.342824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb404f-53d5-4f78-b61b-dfa23e055e93 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:15.347876 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2719b4-1ddc-4b85-8e97-8eb2340fc4c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dfdb39ae2804b2191cea53f2a387c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:15.348518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2719b4-1ddc-4b85-8e97-8eb2340fc4c4 service placement] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:15.348800 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2719b4-1ddc-4b85-8e97-8eb2340fc4c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:15.349072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2719b4-1ddc-4b85-8e97-8eb2340fc4c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:15.350857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1f2719b4-1ddc-4b85-8e97-8eb2340fc4c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:15.362711 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2719b4-1ddc-4b85-8e97-8eb2340fc4c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:15.364337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2719b4-1ddc-4b85-8e97-8eb2340fc4c4 service placement] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:15.374675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1366/2707] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:24:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:21.156220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d533a-9fcd-4182-ba2a-26088a33403c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:21.156917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d533a-9fcd-4182-ba2a-26088a33403c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:21.156917 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d533a-9fcd-4182-ba2a-26088a33403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:21.173484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-505d533a-9fcd-4182-ba2a-26088a33403c None None] MFA Rules not processed for user `c7788bd93c7649368e3fc926a969c7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:21.174750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-505d533a-9fcd-4182-ba2a-26088a33403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:21.230012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1342/2708] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:22.323680 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2719b4-1ddc-4b85-8e97-8eb2340fc4c4 service placement] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:22.383514 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2719b4-1ddc-4b85-8e97-8eb2340fc4c4 service placement] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:22.388632 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:22.389538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:22.389757 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:22.390022 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] PATH_INFO: `/v3/users/0039a8d9050b4f14a88014e785647d21` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:22.391221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0039a8d9050b4f14a88014e785647d21)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:22.393118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:22.572864 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0039a8d9050b4f14a88014e785647d21'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.573541 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0039a8d9050b4f14a88014e785647d21'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.574129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0039a8d9050b4f14a88014e785647d21'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.586522 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0039a8d9050b4f14a88014e785647d21'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.593091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0039a8d9050b4f14a88014e785647d21'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:22.667574 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1367/2709] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:24:22 2022] DELETE /identity/v3/users/0039a8d9050b4f14a88014e785647d21 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:22.672714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708dc38-7c7e-46f4-9e7d-426dfa1d19f4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:22.676328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708dc38-7c7e-46f4-9e7d-426dfa1d19f4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:22.676328 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708dc38-7c7e-46f4-9e7d-426dfa1d19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:22.691324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4708dc38-7c7e-46f4-9e7d-426dfa1d19f4 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:22.692509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4708dc38-7c7e-46f4-9e7d-426dfa1d19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:22.749211 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1343/2710] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:22.758957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:22.762407 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:22.815271 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281be54-fcdd-44bb-852b-fb0e4944e3ea admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:22.818973 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f47fff-050f-4e1d-a95a-50470943dd1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:22.819587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f47fff-050f-4e1d-a95a-50470943dd1d service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:22.819863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f47fff-050f-4e1d-a95a-50470943dd1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:22.820133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f47fff-050f-4e1d-a95a-50470943dd1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:22.829224 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f47fff-050f-4e1d-a95a-50470943dd1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:22.830674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f47fff-050f-4e1d-a95a-50470943dd1d service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:22.840858 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1368/2711] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:24:23.246806 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708dc38-7c7e-46f4-9e7d-426dfa1d19f4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.248214 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4708dc38-7c7e-46f4-9e7d-426dfa1d19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:23.262335 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708dc38-7c7e-46f4-9e7d-426dfa1d19f4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.268360 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.269107 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.269389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.269971 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] PATH_INFO: `/v3/projects/1f9c284dcb9f45048ef6b5a9afea255e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.271525 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9c284dcb9f45048ef6b5a9afea255e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.274032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.386856 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9c284dcb9f45048ef6b5a9afea255e', 'request_id': 'req-fd0f2968-b8bc-4aee-9151-633bd76bba7c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:23.393409 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9c284dcb9f45048ef6b5a9afea255e', 'request_id': 'req-fd0f2968-b8bc-4aee-9151-633bd76bba7c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:23.399712 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9c284dcb9f45048ef6b5a9afea255e', 'request_id': 'req-fd0f2968-b8bc-4aee-9151-633bd76bba7c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:23.501769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] The token cache is being invalidate because project 1f9c284dcb9f45048ef6b5a9afea255e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:24:23.501987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:23.502705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fd0f2968-b8bc-4aee-9151-633bd76bba7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:23.504824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1344/2712] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:24:23 2022] DELETE /identity/v3/projects/1f9c284dcb9f45048ef6b5a9afea255e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:23.509669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e5bb8-3366-49f2-a69c-be0ecf2f10cf None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.510182 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e5bb8-3366-49f2-a69c-be0ecf2f10cf None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.510300 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e5bb8-3366-49f2-a69c-be0ecf2f10cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.528633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-773e5bb8-3366-49f2-a69c-be0ecf2f10cf None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:23.529822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-773e5bb8-3366-49f2-a69c-be0ecf2f10cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:23.584612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1369/2713] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:23.593837 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd63c0-5166-406d-a805-8066b789287f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.594191 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd63c0-5166-406d-a805-8066b789287f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.594467 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd63c0-5166-406d-a805-8066b789287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.613332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-87cd63c0-5166-406d-a805-8066b789287f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:23.614544 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-87cd63c0-5166-406d-a805-8066b789287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:23.622386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1345/2714] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:23.626729 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e5bb8-3366-49f2-a69c-be0ecf2f10cf None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.636160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e5bb8-3366-49f2-a69c-be0ecf2f10cf None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.641399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671088b3-9720-4f85-b418-cb75bc6a63fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.642144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671088b3-9720-4f85-b418-cb75bc6a63fd admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.642425 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671088b3-9720-4f85-b418-cb75bc6a63fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.642694 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671088b3-9720-4f85-b418-cb75bc6a63fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.643483 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671088b3-9720-4f85-b418-cb75bc6a63fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:24:23.643786 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671088b3-9720-4f85-b418-cb75bc6a63fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.645396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671088b3-9720-4f85-b418-cb75bc6a63fd admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.657008 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1370/2715] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:24:23.661156 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd63c0-5166-406d-a805-8066b789287f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.670113 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd63c0-5166-406d-a805-8066b789287f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.674737 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051ffa-7239-4916-897b-15d32117ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.675411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051ffa-7239-4916-897b-15d32117ea24 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.675692 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051ffa-7239-4916-897b-15d32117ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.675965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051ffa-7239-4916-897b-15d32117ea24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.676652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb051ffa-7239-4916-897b-15d32117ea24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.678573 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb051ffa-7239-4916-897b-15d32117ea24 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.785041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1346/2716] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:24:23 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:23.788446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671088b3-9720-4f85-b418-cb75bc6a63fd admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.797277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671088b3-9720-4f85-b418-cb75bc6a63fd admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.853114 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3fffa-3f28-47d6-aabf-0d9e6a24523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.853806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3fffa-3f28-47d6-aabf-0d9e6a24523b admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.854115 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3fffa-3f28-47d6-aabf-0d9e6a24523b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.854391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3fffa-3f28-47d6-aabf-0d9e6a24523b admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.855067 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3fffa-3f28-47d6-aabf-0d9e6a24523b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.856968 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3fffa-3f28-47d6-aabf-0d9e6a24523b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.959760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1371/2717] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:24:23 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:23.964071 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051ffa-7239-4916-897b-15d32117ea24 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:23.974079 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051ffa-7239-4916-897b-15d32117ea24 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:23.978666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132983e0-d937-4211-b992-2f58b2711846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:23.979310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132983e0-d937-4211-b992-2f58b2711846 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:23.979590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132983e0-d937-4211-b992-2f58b2711846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:23.979861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132983e0-d937-4211-b992-2f58b2711846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:23.980574 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132983e0-d937-4211-b992-2f58b2711846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:23.982316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132983e0-d937-4211-b992-2f58b2711846 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:23.992545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1347/2718] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:23.996962 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3fffa-3f28-47d6-aabf-0d9e6a24523b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:24.012647 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3fffa-3f28-47d6-aabf-0d9e6a24523b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:24.016322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59a91f-e70d-4df3-9f71-ba67c73f35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:24.017016 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59a91f-e70d-4df3-9f71-ba67c73f35b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.017298 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59a91f-e70d-4df3-9f71-ba67c73f35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.017576 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59a91f-e70d-4df3-9f71-ba67c73f35b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.018511 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59a91f-e70d-4df3-9f71-ba67c73f35b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:24.020143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59a91f-e70d-4df3-9f71-ba67c73f35b5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:24.030289 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1372/2719] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:24.034564 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132983e0-d937-4211-b992-2f58b2711846 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:24.045599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132983e0-d937-4211-b992-2f58b2711846 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:24.050305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0f19-ffc2-4a52-96a1-a4f14912a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:24.051167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0f19-ffc2-4a52-96a1-a4f14912a6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.051440 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0f19-ffc2-4a52-96a1-a4f14912a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.051855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0f19-ffc2-4a52-96a1-a4f14912a6b2 admin admin] PATH_INFO: `/v3/projects/18a973d171eb4eaeb6efb35a55382c57/users/e6065f33dadf4513a7aa3a91e7d9583b/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.067669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb0f19-ffc2-4a52-96a1-a4f14912a6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a973d171eb4eaeb6efb35a55382c57, user_id=e6065f33dadf4513a7aa3a91e7d9583b, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:24.070566 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb0f19-ffc2-4a52-96a1-a4f14912a6b2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:24.138225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1348/2720] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:24:24 2022] PUT /identity/v3/projects/18a973d171eb4eaeb6efb35a55382c57/users/e6065f33dadf4513a7aa3a91e7d9583b/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:24.148628 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759e32-70f3-457a-81bd-1534bfbc0778 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.148897 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759e32-70f3-457a-81bd-1534bfbc0778 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.149175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759e32-70f3-457a-81bd-1534bfbc0778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.180821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-20759e32-70f3-457a-81bd-1534bfbc0778 None None] MFA Rules not processed for user `e6065f33dadf4513a7aa3a91e7d9583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:24.182191 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-20759e32-70f3-457a-81bd-1534bfbc0778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:24.249389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1373/2721] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:24.260759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0f19-ffc2-4a52-96a1-a4f14912a6b2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:24.262729 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-54eb0f19-ffc2-4a52-96a1-a4f14912a6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:24.322143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0f19-ffc2-4a52-96a1-a4f14912a6b2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:24.326242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ce070-8843-4405-9e13-761cc9367108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:24.326923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce070-8843-4405-9e13-761cc9367108 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:24.327213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce070-8843-4405-9e13-761cc9367108 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:24.327471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce070-8843-4405-9e13-761cc9367108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:24.337715 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ce070-8843-4405-9e13-761cc9367108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:24.338358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ce070-8843-4405-9e13-761cc9367108 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:24.347213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1349/2722] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:24:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:44.730409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20759e32-70f3-457a-81bd-1534bfbc0778 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:44.788163 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20759e32-70f3-457a-81bd-1534bfbc0778 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:44.792570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:44.793421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:44.793696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:44.793963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] PATH_INFO: `/v3/users/e6065f33dadf4513a7aa3a91e7d9583b` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:44.795257 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6065f33dadf4513a7aa3a91e7d9583b)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:44.797181 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:44.988809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6065f33dadf4513a7aa3a91e7d9583b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:44.989406 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6065f33dadf4513a7aa3a91e7d9583b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:44.990036 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6065f33dadf4513a7aa3a91e7d9583b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:45.006087 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6065f33dadf4513a7aa3a91e7d9583b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:45.012780 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6065f33dadf4513a7aa3a91e7d9583b'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:45.072787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1374/2723] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:24:44 2022] DELETE /identity/v3/users/e6065f33dadf4513a7aa3a91e7d9583b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:45.078166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1157-d4a4-4d39-91c7-9a9bab15c153 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:45.078760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1157-d4a4-4d39-91c7-9a9bab15c153 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:45.078861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1157-d4a4-4d39-91c7-9a9bab15c153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:45.095877 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-53ea1157-d4a4-4d39-91c7-9a9bab15c153 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:45.097603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-53ea1157-d4a4-4d39-91c7-9a9bab15c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:45.152065 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1350/2724] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:45.161510 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:45.162921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:45.217735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d3d8-000d-477f-8098-f1cc989dea11 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:45.221359 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab03a3e-7ee2-48e3-ab1a-6dbf911fe928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:45.222101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab03a3e-7ee2-48e3-ab1a-6dbf911fe928 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:45.222389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab03a3e-7ee2-48e3-ab1a-6dbf911fe928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:45.222662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab03a3e-7ee2-48e3-ab1a-6dbf911fe928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:45.231371 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab03a3e-7ee2-48e3-ab1a-6dbf911fe928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:45.233291 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab03a3e-7ee2-48e3-ab1a-6dbf911fe928 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:45.242812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1375/2725] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:45.594781 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea1157-d4a4-4d39-91c7-9a9bab15c153 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:45.596232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-53ea1157-d4a4-4d39-91c7-9a9bab15c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:45.609045 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea1157-d4a4-4d39-91c7-9a9bab15c153 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:45.613657 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:45.614561 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:45.614844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:45.615121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] PATH_INFO: `/v3/projects/18a973d171eb4eaeb6efb35a55382c57` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:45.616300 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a973d171eb4eaeb6efb35a55382c57)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:45.618282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:45.712290 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a973d171eb4eaeb6efb35a55382c57', 'request_id': 'req-99c4b719-7c01-4159-9c99-347e0306c10c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:45.719019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a973d171eb4eaeb6efb35a55382c57', 'request_id': 'req-99c4b719-7c01-4159-9c99-347e0306c10c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:45.724205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a973d171eb4eaeb6efb35a55382c57', 'request_id': 'req-99c4b719-7c01-4159-9c99-347e0306c10c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:45.808996 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] The token cache is being invalidate because project 18a973d171eb4eaeb6efb35a55382c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:24:45.809281 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:45.809922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-99c4b719-7c01-4159-9c99-347e0306c10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:24:45.811575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1351/2726] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:24:45 2022] DELETE /identity/v3/projects/18a973d171eb4eaeb6efb35a55382c57 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:45.818709 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba227b1e-489b-4a1c-8b93-f9e9244b248d None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:45.819187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba227b1e-489b-4a1c-8b93-f9e9244b248d None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:45.819303 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba227b1e-489b-4a1c-8b93-f9e9244b248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:45.838013 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ba227b1e-489b-4a1c-8b93-f9e9244b248d None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:45.839225 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ba227b1e-489b-4a1c-8b93-f9e9244b248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:45.897526 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1376/2727] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:45.906175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694fdc-2e10-40c5-a13d-0ca86e8af6b3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:45.906468 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694fdc-2e10-40c5-a13d-0ca86e8af6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:45.906746 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694fdc-2e10-40c5-a13d-0ca86e8af6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:45.927398 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b3694fdc-2e10-40c5-a13d-0ca86e8af6b3 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:45.928551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b3694fdc-2e10-40c5-a13d-0ca86e8af6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:45.936536 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1352/2728] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:45.940966 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba227b1e-489b-4a1c-8b93-f9e9244b248d None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:45.950612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba227b1e-489b-4a1c-8b93-f9e9244b248d None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:45.955739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60c873-8468-45f6-9c1e-d7938ae8fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:45.956399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c873-8468-45f6-9c1e-d7938ae8fc9c admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:45.956679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c873-8468-45f6-9c1e-d7938ae8fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:45.956954 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c873-8468-45f6-9c1e-d7938ae8fc9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:45.957941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60c873-8468-45f6-9c1e-d7938ae8fc9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:24:45.958278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60c873-8468-45f6-9c1e-d7938ae8fc9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:45.959881 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60c873-8468-45f6-9c1e-d7938ae8fc9c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:45.972055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1377/2729] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:24:45.976367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694fdc-2e10-40c5-a13d-0ca86e8af6b3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:45.985783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694fdc-2e10-40c5-a13d-0ca86e8af6b3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:45.990550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dd08c-1659-472c-bc17-11bf2ad82260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:45.991202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd08c-1659-472c-bc17-11bf2ad82260 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:45.991487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd08c-1659-472c-bc17-11bf2ad82260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:45.991765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd08c-1659-472c-bc17-11bf2ad82260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:45.992453 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dd08c-1659-472c-bc17-11bf2ad82260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:45.994444 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dd08c-1659-472c-bc17-11bf2ad82260 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:46.069897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1353/2730] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:24:45 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:46.074471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60c873-8468-45f6-9c1e-d7938ae8fc9c admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:46.085779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60c873-8468-45f6-9c1e-d7938ae8fc9c admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:46.140607 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc4069-4f01-4889-8804-fe4ef27e1f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:46.141187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4069-4f01-4889-8804-fe4ef27e1f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:46.141465 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4069-4f01-4889-8804-fe4ef27e1f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:46.141732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4069-4f01-4889-8804-fe4ef27e1f13 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:46.142444 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc4069-4f01-4889-8804-fe4ef27e1f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:46.144373 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc4069-4f01-4889-8804-fe4ef27e1f13 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:46.267877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1378/2731] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:24:46 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:46.271982 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dd08c-1659-472c-bc17-11bf2ad82260 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:46.282031 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dd08c-1659-472c-bc17-11bf2ad82260 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:46.286744 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47763bb3-f084-4956-a042-5a3fb5bdf32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:46.287388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47763bb3-f084-4956-a042-5a3fb5bdf32a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:46.287666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47763bb3-f084-4956-a042-5a3fb5bdf32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:46.287936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47763bb3-f084-4956-a042-5a3fb5bdf32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:46.288760 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47763bb3-f084-4956-a042-5a3fb5bdf32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:46.290389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47763bb3-f084-4956-a042-5a3fb5bdf32a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:46.300610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1354/2732] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:46.304379 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc4069-4f01-4889-8804-fe4ef27e1f13 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:46.314900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc4069-4f01-4889-8804-fe4ef27e1f13 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:46.319583 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84352e2-c942-4399-8130-1e6402c3f73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:46.320230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84352e2-c942-4399-8130-1e6402c3f73b admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:46.320528 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84352e2-c942-4399-8130-1e6402c3f73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:46.320877 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84352e2-c942-4399-8130-1e6402c3f73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:46.321602 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84352e2-c942-4399-8130-1e6402c3f73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:46.323210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84352e2-c942-4399-8130-1e6402c3f73b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:46.334218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1379/2733] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:46.338297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47763bb3-f084-4956-a042-5a3fb5bdf32a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:46.348030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47763bb3-f084-4956-a042-5a3fb5bdf32a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:46.352489 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19df887-1721-4b04-96a0-56960f5f3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:46.353371 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19df887-1721-4b04-96a0-56960f5f3508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:46.353644 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19df887-1721-4b04-96a0-56960f5f3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:46.353913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19df887-1721-4b04-96a0-56960f5f3508 admin admin] PATH_INFO: `/v3/projects/0b6bd797b8e04be18b7484855142b067/users/4109353d2bd843bf9756404990ea6832/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:46.370943 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19df887-1721-4b04-96a0-56960f5f3508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6bd797b8e04be18b7484855142b067, user_id=4109353d2bd843bf9756404990ea6832, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:46.374128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19df887-1721-4b04-96a0-56960f5f3508 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:46.461691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1355/2734] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:24:46 2022] PUT /identity/v3/projects/0b6bd797b8e04be18b7484855142b067/users/4109353d2bd843bf9756404990ea6832/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:46.466662 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d61f0-3cb7-485e-a310-0e1e186a5c06 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:46.466945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d61f0-3cb7-485e-a310-0e1e186a5c06 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:46.467221 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d61f0-3cb7-485e-a310-0e1e186a5c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:46.484489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f36d61f0-3cb7-485e-a310-0e1e186a5c06 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:46.485670 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f36d61f0-3cb7-485e-a310-0e1e186a5c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:46.541014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1380/2735] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:46.550374 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19df887-1721-4b04-96a0-56960f5f3508 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:46.552025 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c19df887-1721-4b04-96a0-56960f5f3508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:46.605950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19df887-1721-4b04-96a0-56960f5f3508 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:46.610024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c0389-46fd-4053-a1ed-bfec15570eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:46.610683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c0389-46fd-4053-a1ed-bfec15570eae service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:46.610961 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c0389-46fd-4053-a1ed-bfec15570eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:46.611236 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c0389-46fd-4053-a1ed-bfec15570eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:46.619823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c0389-46fd-4053-a1ed-bfec15570eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:46.621238 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c0389-46fd-4053-a1ed-bfec15570eae service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:46.630900 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1356/2736] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:24:51.779296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14176a-a73f-4bb6-b637-15d0c6f1e306 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:51.779741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14176a-a73f-4bb6-b637-15d0c6f1e306 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:51.779843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14176a-a73f-4bb6-b637-15d0c6f1e306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:51.814817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ab14176a-a73f-4bb6-b637-15d0c6f1e306 None None] MFA Rules not processed for user `4109353d2bd843bf9756404990ea6832`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:51.816218 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ab14176a-a73f-4bb6-b637-15d0c6f1e306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:51.889742 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1381/2737] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:51.894391 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c0389-46fd-4053-a1ed-bfec15570eae service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:51.904776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c0389-46fd-4053-a1ed-bfec15570eae service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:51.910049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0917f0-830c-4f06-b7ba-6ac85f7ea373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:51.910740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0917f0-830c-4f06-b7ba-6ac85f7ea373 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:51.911021 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0917f0-830c-4f06-b7ba-6ac85f7ea373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:51.911292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0917f0-830c-4f06-b7ba-6ac85f7ea373 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:51.912122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0917f0-830c-4f06-b7ba-6ac85f7ea373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:51.914116 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0917f0-830c-4f06-b7ba-6ac85f7ea373 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:52.004501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1357/2738] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:24:51 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:24:52.005429 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14176a-a73f-4bb6-b637-15d0c6f1e306 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:52.021931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14176a-a73f-4bb6-b637-15d0c6f1e306 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:52.074449 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2bb4-a204-4fb5-8ee3-65409eae4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:52.075164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2bb4-a204-4fb5-8ee3-65409eae4770 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:52.075445 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2bb4-a204-4fb5-8ee3-65409eae4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:52.076215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d2bb4-a204-4fb5-8ee3-65409eae4770 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:52.076907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d2bb4-a204-4fb5-8ee3-65409eae4770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:52.078963 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d2bb4-a204-4fb5-8ee3-65409eae4770 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:52.133432 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1382/2739] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:24:52 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:24:52.134586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0917f0-830c-4f06-b7ba-6ac85f7ea373 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:52.145514 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0917f0-830c-4f06-b7ba-6ac85f7ea373 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:52.150332 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7f1c-2e99-4d1a-aeb4-0af1fd050fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:52.150997 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7f1c-2e99-4d1a-aeb4-0af1fd050fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:52.151278 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7f1c-2e99-4d1a-aeb4-0af1fd050fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:52.151551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7f1c-2e99-4d1a-aeb4-0af1fd050fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:52.152283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e7f1c-2e99-4d1a-aeb4-0af1fd050fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:52.154500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e7f1c-2e99-4d1a-aeb4-0af1fd050fd8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:52.165326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1358/2740] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:24:52.169428 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2bb4-a204-4fb5-8ee3-65409eae4770 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:52.180079 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d2bb4-a204-4fb5-8ee3-65409eae4770 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:52.184984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4483167-4837-4351-bcff-6be6a4417075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:52.185901 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4483167-4837-4351-bcff-6be6a4417075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:52.186228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4483167-4837-4351-bcff-6be6a4417075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:52.186533 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4483167-4837-4351-bcff-6be6a4417075 admin admin] PATH_INFO: `/v3/projects/ff1e322046a64fcf804af32d3a3983a8/users/a4b2da79c5984fd1a25b5014c9e258cf/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:52.202228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4483167-4837-4351-bcff-6be6a4417075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1e322046a64fcf804af32d3a3983a8, user_id=a4b2da79c5984fd1a25b5014c9e258cf, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:52.204906 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4483167-4837-4351-bcff-6be6a4417075 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:52.433380 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1383/2741] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:24:52 2022] PUT /identity/v3/projects/ff1e322046a64fcf804af32d3a3983a8/users/a4b2da79c5984fd1a25b5014c9e258cf/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:52.437822 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7f1c-2e99-4d1a-aeb4-0af1fd050fd8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:52.447824 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7f1c-2e99-4d1a-aeb4-0af1fd050fd8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:52.503177 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f26410-cfd4-4f3c-8410-48e457111bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:52.503852 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26410-cfd4-4f3c-8410-48e457111bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:52.504128 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26410-cfd4-4f3c-8410-48e457111bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:52.504394 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26410-cfd4-4f3c-8410-48e457111bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:52.505119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f26410-cfd4-4f3c-8410-48e457111bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:52.506798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f26410-cfd4-4f3c-8410-48e457111bc8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:52.517572 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1359/2742] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:24:52.521633 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4483167-4837-4351-bcff-6be6a4417075 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:52.531747 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4483167-4837-4351-bcff-6be6a4417075 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:52.536207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6470d-4acc-4164-9c82-d5bacbb2edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:52.537065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6470d-4acc-4164-9c82-d5bacbb2edf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:52.537338 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6470d-4acc-4164-9c82-d5bacbb2edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:52.537605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6470d-4acc-4164-9c82-d5bacbb2edf8 admin admin] PATH_INFO: `/v3/projects/ff1e322046a64fcf804af32d3a3983a8/users/a4b2da79c5984fd1a25b5014c9e258cf/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:52.539548 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6470d-4acc-4164-9c82-d5bacbb2edf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1e322046a64fcf804af32d3a3983a8, user_id=a4b2da79c5984fd1a25b5014c9e258cf, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:52.542206 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6470d-4acc-4164-9c82-d5bacbb2edf8 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:52.551969 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1384/2743] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:24:52 2022] PUT /identity/v3/projects/ff1e322046a64fcf804af32d3a3983a8/users/a4b2da79c5984fd1a25b5014c9e258cf/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:24:58.036790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e63b8-5dba-41c9-b9bd-3333c5188243 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:58.037295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e63b8-5dba-41c9-b9bd-3333c5188243 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:58.037295 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e63b8-5dba-41c9-b9bd-3333c5188243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:58.069025 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-111e63b8-5dba-41c9-b9bd-3333c5188243 None None] MFA Rules not processed for user `a4b2da79c5984fd1a25b5014c9e258cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:24:58.070402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-111e63b8-5dba-41c9-b9bd-3333c5188243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:58.143163 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1360/2744] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:24:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:24:58.157738 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6470d-4acc-4164-9c82-d5bacbb2edf8 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:24:58.159639 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a9c6470d-4acc-4164-9c82-d5bacbb2edf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:24:58.233170 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6470d-4acc-4164-9c82-d5bacbb2edf8 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:24:58.239143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474e9b0-bcbd-4abf-88ac-9abb19a784c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:24:58.239851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474e9b0-bcbd-4abf-88ac-9abb19a784c0 service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:24:58.240139 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474e9b0-bcbd-4abf-88ac-9abb19a784c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:24:58.240414 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474e9b0-bcbd-4abf-88ac-9abb19a784c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:24:58.296900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474e9b0-bcbd-4abf-88ac-9abb19a784c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:24:58.298446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474e9b0-bcbd-4abf-88ac-9abb19a784c0 service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:24:58.307259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1385/2745] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:24:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:25:00.813166 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84670a77-e2a0-4b50-a276-95f4206f44f5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:00.813780 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84670a77-e2a0-4b50-a276-95f4206f44f5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:00.813892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84670a77-e2a0-4b50-a276-95f4206f44f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:00.833150 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-84670a77-e2a0-4b50-a276-95f4206f44f5 None None] MFA Rules not processed for user `4109353d2bd843bf9756404990ea6832`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:25:00.835534 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-84670a77-e2a0-4b50-a276-95f4206f44f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:00.846535 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1361/2746] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:25:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:25:19.397045 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474e9b0-bcbd-4abf-88ac-9abb19a784c0 service nova] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:19.398480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-2474e9b0-bcbd-4abf-88ac-9abb19a784c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:19.453783 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474e9b0-bcbd-4abf-88ac-9abb19a784c0 service nova] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:19.457947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739aed0-d3bf-40c9-8279-1fe5df765ad8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9237b353da546989b399ee9702d1bd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:19.458869 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739aed0-d3bf-40c9-8279-1fe5df765ad8 service glance] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:19.459148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739aed0-d3bf-40c9-8279-1fe5df765ad8 service glance] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:19.459419 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739aed0-d3bf-40c9-8279-1fe5df765ad8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:19.461325 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-d739aed0-d3bf-40c9-8279-1fe5df765ad8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:19.475900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739aed0-d3bf-40c9-8279-1fe5df765ad8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:19.477342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739aed0-d3bf-40c9-8279-1fe5df765ad8 service glance] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:19.488792 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1386/2747] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:25:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:25:23.038638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84670a77-e2a0-4b50-a276-95f4206f44f5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:23.094580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84670a77-e2a0-4b50-a276-95f4206f44f5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:23.098745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3fb02-0c98-435e-98e4-11382a5a28ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:23.100228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fb02-0c98-435e-98e4-11382a5a28ce service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:23.100228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fb02-0c98-435e-98e4-11382a5a28ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:23.100228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fb02-0c98-435e-98e4-11382a5a28ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:23.101761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5cb3fb02-0c98-435e-98e4-11382a5a28ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:23.116587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3fb02-0c98-435e-98e4-11382a5a28ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:23.118345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3fb02-0c98-435e-98e4-11382a5a28ce service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:23.130357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1362/2748] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:25:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:25:37.460921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739aed0-d3bf-40c9-8279-1fe5df765ad8 service glance] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:37.470102 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739aed0-d3bf-40c9-8279-1fe5df765ad8 service glance] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:37.474335 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db39a-b9b5-4e7f-a251-e0cf54ac68ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:37.474967 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db39a-b9b5-4e7f-a251-e0cf54ac68ae service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:37.475247 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db39a-b9b5-4e7f-a251-e0cf54ac68ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:37.475515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db39a-b9b5-4e7f-a251-e0cf54ac68ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:37.487500 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5db39a-b9b5-4e7f-a251-e0cf54ac68ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:37.489233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5db39a-b9b5-4e7f-a251-e0cf54ac68ae service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:37.500691 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1387/2749] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:25:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:25:40.182359 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc62509-18a8-4381-85e2-986afe1cd41e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:40.182834 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc62509-18a8-4381-85e2-986afe1cd41e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:40.183140 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc62509-18a8-4381-85e2-986afe1cd41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:40.204907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-dcc62509-18a8-4381-85e2-986afe1cd41e None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:25:40.204907 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-dcc62509-18a8-4381-85e2-986afe1cd41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:40.263625 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1363/2750] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:25:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:25:40.415975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db39a-b9b5-4e7f-a251-e0cf54ac68ae service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:40.418070 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7e5db39a-b9b5-4e7f-a251-e0cf54ac68ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:40.555610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db39a-b9b5-4e7f-a251-e0cf54ac68ae service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:40.570701 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2c9da-a863-4ab2-8f83-cc0d6ed03a27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:40.571598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2c9da-a863-4ab2-8f83-cc0d6ed03a27 service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:40.572055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2c9da-a863-4ab2-8f83-cc0d6ed03a27 service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:40.572484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2c9da-a863-4ab2-8f83-cc0d6ed03a27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:40.599650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2c9da-a863-4ab2-8f83-cc0d6ed03a27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:40.601292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2c9da-a863-4ab2-8f83-cc0d6ed03a27 service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:40.612648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1388/2751] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:25:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:25:45.171388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc62509-18a8-4381-85e2-986afe1cd41e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:45.181563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc62509-18a8-4381-85e2-986afe1cd41e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:45.185483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:45.191701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:45.191701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:45.191701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:45.191701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:45.261240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:45.262714 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:45.282455 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1364/2752] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:25:52.354910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2c9da-a863-4ab2-8f83-cc0d6ed03a27 service swift] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:52.356370 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-74a2c9da-a863-4ab2-8f83-cc0d6ed03a27 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:52.368766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2c9da-a863-4ab2-8f83-cc0d6ed03a27 service swift] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:52.372515 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8b6e-d7e7-4b24-8e8d-1aa42584ab7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:52.373211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8b6e-d7e7-4b24-8e8d-1aa42584ab7f service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:52.373560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8b6e-d7e7-4b24-8e8d-1aa42584ab7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:52.373903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8b6e-d7e7-4b24-8e8d-1aa42584ab7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:52.375759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-60ca8b6e-d7e7-4b24-8e8d-1aa42584ab7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:52.385260 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca8b6e-d7e7-4b24-8e8d-1aa42584ab7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:52.386803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca8b6e-d7e7-4b24-8e8d-1aa42584ab7f service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:52.395873 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1389/2753] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:25:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:25:53.771932 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:53.773407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:53.786703 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b95731-cf71-4945-9a9c-f56e9d14736f service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:53.790883 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:53.791769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:53.792082 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:53.792357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] PATH_INFO: `/v3/users/b34f24054c204d7cb69ca41099913ca5` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:53.793533 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34f24054c204d7cb69ca41099913ca5)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:53.795466 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:53.995969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34f24054c204d7cb69ca41099913ca5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:53.996621 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34f24054c204d7cb69ca41099913ca5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.008480 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34f24054c204d7cb69ca41099913ca5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.009132 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34f24054c204d7cb69ca41099913ca5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.016030 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34f24054c204d7cb69ca41099913ca5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.079316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1365/2754] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:25:53 2022] DELETE /identity/v3/users/b34f24054c204d7cb69ca41099913ca5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:25:54.309820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8b6e-d7e7-4b24-8e8d-1aa42584ab7f service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:54.322250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8b6e-d7e7-4b24-8e8d-1aa42584ab7f service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:54.375956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:54.376803 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:54.377082 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:54.377354 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] PATH_INFO: `/v3/projects/b025f7f102ee46fa92e9bb7445e59daa` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:54.378552 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b025f7f102ee46fa92e9bb7445e59daa)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:54.380957 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:54.467910 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b025f7f102ee46fa92e9bb7445e59daa', 'request_id': 'req-c6be691b-c372-4825-9ab8-2a02208ac760'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.530812 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b025f7f102ee46fa92e9bb7445e59daa', 'request_id': 'req-c6be691b-c372-4825-9ab8-2a02208ac760'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.536187 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b025f7f102ee46fa92e9bb7445e59daa', 'request_id': 'req-c6be691b-c372-4825-9ab8-2a02208ac760'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.546692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] The token cache is being invalidate because project b025f7f102ee46fa92e9bb7445e59daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:25:54.546976 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.547581 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.549121 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1390/2755] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:25:54 2022] DELETE /identity/v3/projects/b025f7f102ee46fa92e9bb7445e59daa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:25:54.553083 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:54.554429 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:54.568125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadda6c-4b2c-4a17-a75c-47b7ba677442 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:54.621121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:54.621975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:54.622282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:54.622549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] PATH_INFO: `/v3/users/c010bb65be6d490c97d955d66261bdf5` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:54.623709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c010bb65be6d490c97d955d66261bdf5)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:54.625613 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:54.779041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c010bb65be6d490c97d955d66261bdf5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.779705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c010bb65be6d490c97d955d66261bdf5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.791885 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c010bb65be6d490c97d955d66261bdf5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.792484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c010bb65be6d490c97d955d66261bdf5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.799119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c010bb65be6d490c97d955d66261bdf5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:54.862563 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1366/2756] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:25:54 2022] DELETE /identity/v3/users/c010bb65be6d490c97d955d66261bdf5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:25:55.121899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:55.123367 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:55.136204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be691b-c372-4825-9ab8-2a02208ac760 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:55.190944 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:55.191798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:55.192106 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:55.192378 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] PATH_INFO: `/v3/projects/e011d38e61094c908888610db7e37aec` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:55.193657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e011d38e61094c908888610db7e37aec)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:55.195582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:55.320351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e011d38e61094c908888610db7e37aec', 'request_id': 'req-7e79551d-abd4-406b-b71b-4b8cb752ce68'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:55.376867 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e011d38e61094c908888610db7e37aec', 'request_id': 'req-7e79551d-abd4-406b-b71b-4b8cb752ce68'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:55.382598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e011d38e61094c908888610db7e37aec', 'request_id': 'req-7e79551d-abd4-406b-b71b-4b8cb752ce68'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:55.394329 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] The token cache is being invalidate because project e011d38e61094c908888610db7e37aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:25:55.396168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:55.396168 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:25:55.397735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1391/2757] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:25:55 2022] DELETE /identity/v3/projects/e011d38e61094c908888610db7e37aec => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:25:56.722551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:56.722551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:56.793627 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630f885-aeb8-48d5-90f8-814679a63051 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:56.857617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ca9c-9cb6-44d5-ab07-a7bb9b3e750c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:56.858297 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ca9c-9cb6-44d5-ab07-a7bb9b3e750c service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:56.858576 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ca9c-9cb6-44d5-ab07-a7bb9b3e750c service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:56.858848 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ca9c-9cb6-44d5-ab07-a7bb9b3e750c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:56.860609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d485ca9c-9cb6-44d5-ab07-a7bb9b3e750c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:56.873317 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ca9c-9cb6-44d5-ab07-a7bb9b3e750c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:56.877478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ca9c-9cb6-44d5-ab07-a7bb9b3e750c service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:56.885789 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1367/2758] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:25:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:25:58.382410 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:25:58.383797 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:58.452405 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79551d-abd4-406b-b71b-4b8cb752ce68 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:25:58.458021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dfdb39ae2804b2191cea53f2a387c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:25:58.458686 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:25:58.458960 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:25:58.459227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:25:58.461228 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:25:58.472388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:25:58.474693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:25:58.484381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1392/2759] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:25:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:00.574555 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a913e-2ff5-44f6-b447-33ca9cb754f4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:00.575019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a913e-2ff5-44f6-b447-33ca9cb754f4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:00.575126 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a913e-2ff5-44f6-b447-33ca9cb754f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:00.592629 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3d1a913e-2ff5-44f6-b447-33ca9cb754f4 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:26:00.593788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3d1a913e-2ff5-44f6-b447-33ca9cb754f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:00.646487 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1368/2760] 10.222.0.44 () {58 vars in 1009 bytes} [Mon May 16 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:26:00.658347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:00.659761 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:00.724941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66661cee-6c02-4da9-9926-c73f5d4665ce service placement] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:00.729900 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9b6f6-42aa-46aa-93a1-b284aa70db7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:00.730567 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9b6f6-42aa-46aa-93a1-b284aa70db7b service swift] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:00.730848 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9b6f6-42aa-46aa-93a1-b284aa70db7b service swift] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:00.731148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9b6f6-42aa-46aa-93a1-b284aa70db7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:00.739392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9b6f6-42aa-46aa-93a1-b284aa70db7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:00.741019 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9b6f6-42aa-46aa-93a1-b284aa70db7b service swift] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:00.748815 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1393/2761] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:26:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 15:26:15.600594 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a913e-2ff5-44f6-b447-33ca9cb754f4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:15.602119 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3d1a913e-2ff5-44f6-b447-33ca9cb754f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:15.617930 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a913e-2ff5-44f6-b447-33ca9cb754f4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:15.623322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352447b-c784-4081-9e15-c56452a8afe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:15.623953 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352447b-c784-4081-9e15-c56452a8afe0 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:15.624228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352447b-c784-4081-9e15-c56452a8afe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:15.624496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352447b-c784-4081-9e15-c56452a8afe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:15.626456 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0352447b-c784-4081-9e15-c56452a8afe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:15.682734 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352447b-c784-4081-9e15-c56452a8afe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:15.684235 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352447b-c784-4081-9e15-c56452a8afe0 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:15.692904 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1369/2762] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:26:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:16.482242 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e897-7151-4d8b-9acd-22ed9a0bed54 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:16.482779 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e897-7151-4d8b-9acd-22ed9a0bed54 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:16.482892 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e897-7151-4d8b-9acd-22ed9a0bed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:16.499464 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-f632e897-7151-4d8b-9acd-22ed9a0bed54 None None] MFA Rules not processed for user `8f9bad450f474e5a835d7c70b210e60e`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:26:16.500644 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f632e897-7151-4d8b-9acd-22ed9a0bed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:16.507716 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1394/2763] 10.222.0.44 () {58 vars in 967 bytes} [Mon May 16 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:26:16.519761 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352447b-c784-4081-9e15-c56452a8afe0 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:16.531369 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352447b-c784-4081-9e15-c56452a8afe0 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:16.536178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d898-b25a-47ba-ba17-4bbdc6ffbd9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a6668cb0bda4d61b6b96f547a422830', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:16.536810 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d898-b25a-47ba-ba17-4bbdc6ffbd9d service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:16.537739 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d898-b25a-47ba-ba17-4bbdc6ffbd9d service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:16.538038 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d898-b25a-47ba-ba17-4bbdc6ffbd9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:16.545788 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24d898-b25a-47ba-ba17-4bbdc6ffbd9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:16.547389 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24d898-b25a-47ba-ba17-4bbdc6ffbd9d service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:16.555362 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1370/2764] 10.222.0.44 () {60 vars in 1384 bytes} [Mon May 16 15:26:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 15:26:51.837178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632e897-7151-4d8b-9acd-22ed9a0bed54 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:51.839279 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f632e897-7151-4d8b-9acd-22ed9a0bed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:51.944193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632e897-7151-4d8b-9acd-22ed9a0bed54 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:51.966273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:51.973549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:51.973549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:51.973549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:51.973549 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:51.984268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:51.985912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:51.997887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1395/2765] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:26:56.391160 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d898-b25a-47ba-ba17-4bbdc6ffbd9d service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:26:56.392524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9b24d898-b25a-47ba-ba17-4bbdc6ffbd9d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:56.475733 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d898-b25a-47ba-ba17-4bbdc6ffbd9d service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:26:56.479853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3610-1c38-414d-9c61-51448052f4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:26:56.480486 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3610-1c38-414d-9c61-51448052f4ad service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:26:56.480769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3610-1c38-414d-9c61-51448052f4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:26:56.481041 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3610-1c38-414d-9c61-51448052f4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:26:56.482768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ad2e3610-1c38-414d-9c61-51448052f4ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:26:56.561167 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3610-1c38-414d-9c61-51448052f4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:26:56.562626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3610-1c38-414d-9c61-51448052f4ad service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:26:56.580725 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1371/2766] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 15:27:00.043423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:00.046836 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:00.058595 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831d7cf-c0bc-4fb3-bee0-065aee1fe37a service nova] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:00.063179 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:00.064031 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:00.064308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:00.064582 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] PATH_INFO: `/v3/users/c7788bd93c7649368e3fc926a969c7ed` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:00.065769 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7788bd93c7649368e3fc926a969c7ed)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:00.067710 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:00.208672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7788bd93c7649368e3fc926a969c7ed'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.209310 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7788bd93c7649368e3fc926a969c7ed'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.209926 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7788bd93c7649368e3fc926a969c7ed'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.221735 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7788bd93c7649368e3fc926a969c7ed'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.228857 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1cc531c0-ea38-4789-8455-e862443b2987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7788bd93c7649368e3fc926a969c7ed'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.320658 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1396/2767] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:27:00 2022] DELETE /identity/v3/users/c7788bd93c7649368e3fc926a969c7ed => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:00.556434 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3610-1c38-414d-9c61-51448052f4ad service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:00.568048 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3610-1c38-414d-9c61-51448052f4ad service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:00.624176 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:00.625058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:00.625343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:00.625623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] PATH_INFO: `/v3/projects/440329d501de48d19ba51dceaa845197` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:00.626818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440329d501de48d19ba51dceaa845197)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:00.628718 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:00.731913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440329d501de48d19ba51dceaa845197', 'request_id': 'req-573cf960-e06d-4f8c-ab8a-657c65dc1e03'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.737922 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440329d501de48d19ba51dceaa845197', 'request_id': 'req-573cf960-e06d-4f8c-ab8a-657c65dc1e03'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.743653 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440329d501de48d19ba51dceaa845197', 'request_id': 'req-573cf960-e06d-4f8c-ab8a-657c65dc1e03'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.812097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] The token cache is being invalidate because project 440329d501de48d19ba51dceaa845197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:00.812378 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.812977 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-573cf960-e06d-4f8c-ab8a-657c65dc1e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:00.814571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1372/2768] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:00 2022] DELETE /identity/v3/projects/440329d501de48d19ba51dceaa845197 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:00.819563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d62a7-3f42-4ccb-bb9e-e535443c5c97 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:00.819937 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d62a7-3f42-4ccb-bb9e-e535443c5c97 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:00.820746 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d62a7-3f42-4ccb-bb9e-e535443c5c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:00.875535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-282d62a7-3f42-4ccb-bb9e-e535443c5c97 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:00.876667 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-282d62a7-3f42-4ccb-bb9e-e535443c5c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:00.934301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1397/2769] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:00.941989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc552-a796-407e-b034-23f78fb00a5c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:00.942312 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc552-a796-407e-b034-23f78fb00a5c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:00.942586 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc552-a796-407e-b034-23f78fb00a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:00.960709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5a8cc552-a796-407e-b034-23f78fb00a5c None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:00.961872 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5a8cc552-a796-407e-b034-23f78fb00a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:00.969989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1373/2770] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:00.973822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d62a7-3f42-4ccb-bb9e-e535443c5c97 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:00.983656 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d62a7-3f42-4ccb-bb9e-e535443c5c97 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:00.988212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb191e16-0ac9-4598-8ed5-0b8a9273bb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:00.988920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb191e16-0ac9-4598-8ed5-0b8a9273bb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:00.989201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb191e16-0ac9-4598-8ed5-0b8a9273bb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:00.989474 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb191e16-0ac9-4598-8ed5-0b8a9273bb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:00.990222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb191e16-0ac9-4598-8ed5-0b8a9273bb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:00.990529 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb191e16-0ac9-4598-8ed5-0b8a9273bb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:00.992759 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb191e16-0ac9-4598-8ed5-0b8a9273bb27 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:01.003872 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1398/2771] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:27:01.008044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc552-a796-407e-b034-23f78fb00a5c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:01.016964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc552-a796-407e-b034-23f78fb00a5c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:01.021557 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd82577-b080-4325-b2af-8bd2eabb3260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:01.022228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd82577-b080-4325-b2af-8bd2eabb3260 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:01.022513 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd82577-b080-4325-b2af-8bd2eabb3260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:01.022787 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd82577-b080-4325-b2af-8bd2eabb3260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:01.023473 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd82577-b080-4325-b2af-8bd2eabb3260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:01.025357 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd82577-b080-4325-b2af-8bd2eabb3260 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:01.128024 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1374/2772] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:27:01 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:01.132154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb191e16-0ac9-4598-8ed5-0b8a9273bb27 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:01.142135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb191e16-0ac9-4598-8ed5-0b8a9273bb27 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:01.196223 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837aae1-3068-44bf-83cb-13f835379aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:01.196887 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837aae1-3068-44bf-83cb-13f835379aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:01.197172 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837aae1-3068-44bf-83cb-13f835379aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:01.197450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837aae1-3068-44bf-83cb-13f835379aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:01.198175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837aae1-3068-44bf-83cb-13f835379aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:01.200086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837aae1-3068-44bf-83cb-13f835379aa6 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:01.292771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1399/2773] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:27:01 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:01.296778 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd82577-b080-4325-b2af-8bd2eabb3260 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:01.307406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd82577-b080-4325-b2af-8bd2eabb3260 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:01.311944 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748102c-9f12-44f6-b0a4-2f72535b8999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:01.312595 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748102c-9f12-44f6-b0a4-2f72535b8999 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:01.312874 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748102c-9f12-44f6-b0a4-2f72535b8999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:01.313152 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748102c-9f12-44f6-b0a4-2f72535b8999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:01.313875 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748102c-9f12-44f6-b0a4-2f72535b8999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:01.315530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748102c-9f12-44f6-b0a4-2f72535b8999 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:01.325538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1375/2774] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:01.333974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837aae1-3068-44bf-83cb-13f835379aa6 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:01.344446 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837aae1-3068-44bf-83cb-13f835379aa6 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:01.349200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145207a-85bc-4fe4-8b8e-fc9edcc6f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:01.349875 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145207a-85bc-4fe4-8b8e-fc9edcc6f018 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:01.350184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145207a-85bc-4fe4-8b8e-fc9edcc6f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:01.350458 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145207a-85bc-4fe4-8b8e-fc9edcc6f018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:01.351787 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145207a-85bc-4fe4-8b8e-fc9edcc6f018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:01.353402 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145207a-85bc-4fe4-8b8e-fc9edcc6f018 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:01.363573 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1400/2775] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:01.367620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748102c-9f12-44f6-b0a4-2f72535b8999 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:01.377384 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748102c-9f12-44f6-b0a4-2f72535b8999 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:01.382292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad81962-640a-4af1-8944-c0dbc5299155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:01.383121 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad81962-640a-4af1-8944-c0dbc5299155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:01.383405 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad81962-640a-4af1-8944-c0dbc5299155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:01.383684 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad81962-640a-4af1-8944-c0dbc5299155 admin admin] PATH_INFO: `/v3/projects/a9ed30c4f75f4162845669a1db3a86dc/users/3637f71a50164e9fac7cf57a87a3dae0/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:01.397485 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad81962-640a-4af1-8944-c0dbc5299155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ed30c4f75f4162845669a1db3a86dc, user_id=3637f71a50164e9fac7cf57a87a3dae0, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:01.400645 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad81962-640a-4af1-8944-c0dbc5299155 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:01.483713 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1376/2776] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:01 2022] PUT /identity/v3/projects/a9ed30c4f75f4162845669a1db3a86dc/users/3637f71a50164e9fac7cf57a87a3dae0/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:01.494042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eab34-ec5e-4782-9c63-10c057e921e9 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:01.494377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eab34-ec5e-4782-9c63-10c057e921e9 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:01.494674 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eab34-ec5e-4782-9c63-10c057e921e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:01.519796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-c61eab34-ec5e-4782-9c63-10c057e921e9 None None] MFA Rules not processed for user `3637f71a50164e9fac7cf57a87a3dae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:01.520980 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-c61eab34-ec5e-4782-9c63-10c057e921e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:01.582614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1401/2777] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:01.594003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad81962-640a-4af1-8944-c0dbc5299155 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:01.598117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8ad81962-640a-4af1-8944-c0dbc5299155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:01.667991 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad81962-640a-4af1-8944-c0dbc5299155 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:01.673528 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272dacf-bdb3-4874-9aa8-a038dc96bddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:01.674222 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272dacf-bdb3-4874-9aa8-a038dc96bddb service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:01.674508 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272dacf-bdb3-4874-9aa8-a038dc96bddb service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:01.674783 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272dacf-bdb3-4874-9aa8-a038dc96bddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:01.682464 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272dacf-bdb3-4874-9aa8-a038dc96bddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:01.684049 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272dacf-bdb3-4874-9aa8-a038dc96bddb service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:01.692776 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1377/2778] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:09.812383 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eab34-ec5e-4782-9c63-10c057e921e9 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:09.869664 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eab34-ec5e-4782-9c63-10c057e921e9 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:09.874146 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:09.875001 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:09.875281 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:09.875555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] PATH_INFO: `/v3/users/3637f71a50164e9fac7cf57a87a3dae0` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:09.876778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3637f71a50164e9fac7cf57a87a3dae0)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:09.878732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:10.053885 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3637f71a50164e9fac7cf57a87a3dae0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.054562 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3637f71a50164e9fac7cf57a87a3dae0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.055164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3637f71a50164e9fac7cf57a87a3dae0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.067305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3637f71a50164e9fac7cf57a87a3dae0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.074351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3637f71a50164e9fac7cf57a87a3dae0'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.151688 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1402/2779] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:27:09 2022] DELETE /identity/v3/users/3637f71a50164e9fac7cf57a87a3dae0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:10.156262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ebfc8-15dd-4866-89cd-99b5ef3dcebd None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:10.156738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ebfc8-15dd-4866-89cd-99b5ef3dcebd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:10.156867 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ebfc8-15dd-4866-89cd-99b5ef3dcebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:10.173292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cb8ebfc8-15dd-4866-89cd-99b5ef3dcebd None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:10.174496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cb8ebfc8-15dd-4866-89cd-99b5ef3dcebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:10.231914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1378/2780] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:27:10.240924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:10.242404 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:10.297436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9259e-480f-4985-b8f7-863ba17ce588 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:10.301042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c32bf-a0bc-4b44-9243-08a2f8f71ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:10.301673 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c32bf-a0bc-4b44-9243-08a2f8f71ccf service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:10.301956 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c32bf-a0bc-4b44-9243-08a2f8f71ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:10.302259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c32bf-a0bc-4b44-9243-08a2f8f71ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:10.311851 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c32bf-a0bc-4b44-9243-08a2f8f71ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:10.313217 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c32bf-a0bc-4b44-9243-08a2f8f71ccf service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:10.323143 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1403/2781] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:10.705220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ebfc8-15dd-4866-89cd-99b5ef3dcebd None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:10.706671 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cb8ebfc8-15dd-4866-89cd-99b5ef3dcebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:10.718791 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ebfc8-15dd-4866-89cd-99b5ef3dcebd None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:10.723615 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:10.724483 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:10.724768 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:10.725050 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] PATH_INFO: `/v3/projects/a9ed30c4f75f4162845669a1db3a86dc` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:10.726430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ed30c4f75f4162845669a1db3a86dc)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:10.728709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:10.829447 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ed30c4f75f4162845669a1db3a86dc', 'request_id': 'req-3cb56805-adba-4f2b-a13a-df4bc1e33f92'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.835432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ed30c4f75f4162845669a1db3a86dc', 'request_id': 'req-3cb56805-adba-4f2b-a13a-df4bc1e33f92'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.840777 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ed30c4f75f4162845669a1db3a86dc', 'request_id': 'req-3cb56805-adba-4f2b-a13a-df4bc1e33f92'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.890759 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] The token cache is being invalidate because project a9ed30c4f75f4162845669a1db3a86dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:10.891066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.891665 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cb56805-adba-4f2b-a13a-df4bc1e33f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:10.893205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1379/2782] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:10 2022] DELETE /identity/v3/projects/a9ed30c4f75f4162845669a1db3a86dc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:10.898042 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ef677-7a08-421f-a3d3-69e499afe29f None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:10.898636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ef677-7a08-421f-a3d3-69e499afe29f None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:10.898636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ef677-7a08-421f-a3d3-69e499afe29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:10.916175 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-678ef677-7a08-421f-a3d3-69e499afe29f None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:10.917377 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-678ef677-7a08-421f-a3d3-69e499afe29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:10.971534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1404/2783] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:10.979489 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce0d03-dae7-4474-a9be-07a27074e2ee None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:10.979775 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce0d03-dae7-4474-a9be-07a27074e2ee None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:10.980063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce0d03-dae7-4474-a9be-07a27074e2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:10.998133 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-67ce0d03-dae7-4474-a9be-07a27074e2ee None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:10.999344 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-67ce0d03-dae7-4474-a9be-07a27074e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:11.007178 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1380/2784] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:11.011252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ef677-7a08-421f-a3d3-69e499afe29f None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:11.020785 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ef677-7a08-421f-a3d3-69e499afe29f None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:11.025265 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657a6ee-8de0-4ff9-aba3-79c7ec053a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:11.025903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657a6ee-8de0-4ff9-aba3-79c7ec053a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:11.026211 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657a6ee-8de0-4ff9-aba3-79c7ec053a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:11.026484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657a6ee-8de0-4ff9-aba3-79c7ec053a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:11.027201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657a6ee-8de0-4ff9-aba3-79c7ec053a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:11.027527 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657a6ee-8de0-4ff9-aba3-79c7ec053a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:11.029097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657a6ee-8de0-4ff9-aba3-79c7ec053a41 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:11.039825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1405/2785] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:27:11.045032 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce0d03-dae7-4474-a9be-07a27074e2ee None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:11.054008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce0d03-dae7-4474-a9be-07a27074e2ee None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:11.059246 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a60d-6844-4b7c-be29-c95e2d89ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:11.059905 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a60d-6844-4b7c-be29-c95e2d89ca8b admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:11.060181 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a60d-6844-4b7c-be29-c95e2d89ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:11.060446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a60d-6844-4b7c-be29-c95e2d89ca8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:11.061145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a60d-6844-4b7c-be29-c95e2d89ca8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:11.063044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a60d-6844-4b7c-be29-c95e2d89ca8b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:11.151617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1381/2786] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:27:11 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:11.155611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657a6ee-8de0-4ff9-aba3-79c7ec053a41 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:11.166120 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657a6ee-8de0-4ff9-aba3-79c7ec053a41 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:11.219903 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04680-6e79-47ad-b977-73a1db77d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:11.220554 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04680-6e79-47ad-b977-73a1db77d3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:11.220832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04680-6e79-47ad-b977-73a1db77d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:11.221100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b04680-6e79-47ad-b977-73a1db77d3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:11.221766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b04680-6e79-47ad-b977-73a1db77d3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:11.223692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b04680-6e79-47ad-b977-73a1db77d3b1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:11.293860 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1406/2787] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:27:11 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:11.297921 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a60d-6844-4b7c-be29-c95e2d89ca8b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:11.308229 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a60d-6844-4b7c-be29-c95e2d89ca8b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:11.313108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eefbc-5f0e-4789-9ab0-134b36a5cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:11.313797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eefbc-5f0e-4789-9ab0-134b36a5cb6f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:11.314109 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eefbc-5f0e-4789-9ab0-134b36a5cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:11.314388 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eefbc-5f0e-4789-9ab0-134b36a5cb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:11.315111 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eefbc-5f0e-4789-9ab0-134b36a5cb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:11.316749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eefbc-5f0e-4789-9ab0-134b36a5cb6f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:11.326887 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1382/2788] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:11.332278 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04680-6e79-47ad-b977-73a1db77d3b1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:11.342941 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b04680-6e79-47ad-b977-73a1db77d3b1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:11.347660 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1277e-0fc7-446c-8644-c5edf0f51d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:11.348301 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1277e-0fc7-446c-8644-c5edf0f51d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:11.348579 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1277e-0fc7-446c-8644-c5edf0f51d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:11.348850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1277e-0fc7-446c-8644-c5edf0f51d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:11.352708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1277e-0fc7-446c-8644-c5edf0f51d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:11.352708 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1277e-0fc7-446c-8644-c5edf0f51d0c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:11.361280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1407/2789] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:11.365195 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eefbc-5f0e-4789-9ab0-134b36a5cb6f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:11.375164 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eefbc-5f0e-4789-9ab0-134b36a5cb6f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:11.379808 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd8e22-e385-4fb1-9ac2-5cb381ca644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:11.380691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd8e22-e385-4fb1-9ac2-5cb381ca644f admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:11.380976 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd8e22-e385-4fb1-9ac2-5cb381ca644f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:11.381275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd8e22-e385-4fb1-9ac2-5cb381ca644f admin admin] PATH_INFO: `/v3/projects/56b0022171474dac9ed310332102dca2/users/14ca028080594039bcf38cf6468dff52/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:11.395610 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd8e22-e385-4fb1-9ac2-5cb381ca644f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b0022171474dac9ed310332102dca2, user_id=14ca028080594039bcf38cf6468dff52, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:11.398271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd8e22-e385-4fb1-9ac2-5cb381ca644f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:11.584499 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1383/2790] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:11 2022] PUT /identity/v3/projects/56b0022171474dac9ed310332102dca2/users/14ca028080594039bcf38cf6468dff52/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:11.596721 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57392e2b-7ecb-437a-b65d-522b992ed671 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:11.597034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57392e2b-7ecb-437a-b65d-522b992ed671 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:11.597312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57392e2b-7ecb-437a-b65d-522b992ed671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:11.623066 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-57392e2b-7ecb-437a-b65d-522b992ed671 None None] MFA Rules not processed for user `14ca028080594039bcf38cf6468dff52`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:11.624256 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-57392e2b-7ecb-437a-b65d-522b992ed671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:11.684617 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1408/2791] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:11.695964 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd8e22-e385-4fb1-9ac2-5cb381ca644f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:11.698284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-06cd8e22-e385-4fb1-9ac2-5cb381ca644f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:11.775802 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd8e22-e385-4fb1-9ac2-5cb381ca644f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:11.781478 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99956909-b840-4b4b-afd2-f830e423c264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc19a5d9ce774f39aa49ab7c64ba682e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:11.782145 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99956909-b840-4b4b-afd2-f830e423c264 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:11.782426 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99956909-b840-4b4b-afd2-f830e423c264 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:11.782695 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99956909-b840-4b4b-afd2-f830e423c264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:11.790239 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99956909-b840-4b4b-afd2-f830e423c264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:11.791855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99956909-b840-4b4b-afd2-f830e423c264 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:11.800283 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1384/2792] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:14.853675 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57392e2b-7ecb-437a-b65d-522b992ed671 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:14.911125 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57392e2b-7ecb-437a-b65d-522b992ed671 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:14.915538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:14.916388 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:14.916659 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:14.916925 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] PATH_INFO: `/v3/users/14ca028080594039bcf38cf6468dff52` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:14.918101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ca028080594039bcf38cf6468dff52)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:14.920003 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:15.151180 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ca028080594039bcf38cf6468dff52'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:15.151843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ca028080594039bcf38cf6468dff52'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:15.152437 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ca028080594039bcf38cf6468dff52'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:15.163587 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ca028080594039bcf38cf6468dff52'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:15.170733 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ca028080594039bcf38cf6468dff52'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:15.234679 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1409/2793] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:27:14 2022] DELETE /identity/v3/users/14ca028080594039bcf38cf6468dff52 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:15.239068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94451c4a-652b-44b9-839a-c9199ebc764e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:15.239589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94451c4a-652b-44b9-839a-c9199ebc764e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:15.239702 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94451c4a-652b-44b9-839a-c9199ebc764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:15.257617 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-94451c4a-652b-44b9-839a-c9199ebc764e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:15.258873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-94451c4a-652b-44b9-839a-c9199ebc764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:15.315248 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1385/2794] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 15:27:15.325030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:15.326478 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:15.382241 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42161f-d592-4271-8fb0-78b5613844b4 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:15.385692 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466a508-e57e-405a-9c3f-43bb92ea83b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:15.386361 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466a508-e57e-405a-9c3f-43bb92ea83b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:15.386634 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466a508-e57e-405a-9c3f-43bb92ea83b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:15.386904 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466a508-e57e-405a-9c3f-43bb92ea83b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:15.395635 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466a508-e57e-405a-9c3f-43bb92ea83b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:15.397053 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466a508-e57e-405a-9c3f-43bb92ea83b0 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:15.406173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1410/2795] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:15.735662 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94451c4a-652b-44b9-839a-c9199ebc764e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:15.737091 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-94451c4a-652b-44b9-839a-c9199ebc764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:15.750355 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94451c4a-652b-44b9-839a-c9199ebc764e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:15.755168 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:15.756044 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:15.756322 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:15.756593 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] PATH_INFO: `/v3/projects/56b0022171474dac9ed310332102dca2` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:15.757987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b0022171474dac9ed310332102dca2)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:15.760026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:15.851906 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b0022171474dac9ed310332102dca2', 'request_id': 'req-90cb509f-07f2-4937-a3b2-185d400cf585'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:15.860652 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b0022171474dac9ed310332102dca2', 'request_id': 'req-90cb509f-07f2-4937-a3b2-185d400cf585'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:15.865978 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b0022171474dac9ed310332102dca2', 'request_id': 'req-90cb509f-07f2-4937-a3b2-185d400cf585'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:16.002136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] The token cache is being invalidate because project 56b0022171474dac9ed310332102dca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:16.002427 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:16.003144 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-90cb509f-07f2-4937-a3b2-185d400cf585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:16.005043 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1386/2796] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:15 2022] DELETE /identity/v3/projects/56b0022171474dac9ed310332102dca2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:16.010489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aec82c-1d1a-45cd-bfd5-740bcea19e9e None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.010986 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aec82c-1d1a-45cd-bfd5-740bcea19e9e None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.011094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aec82c-1d1a-45cd-bfd5-740bcea19e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.028584 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-a2aec82c-1d1a-45cd-bfd5-740bcea19e9e None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:16.029760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-a2aec82c-1d1a-45cd-bfd5-740bcea19e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:16.085288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1411/2797] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:16.094007 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d925-7744-454c-80d9-31c671657fd1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.094324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d925-7744-454c-80d9-31c671657fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.094600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d925-7744-454c-80d9-31c671657fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.112865 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5b32d925-7744-454c-80d9-31c671657fd1 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:16.114068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5b32d925-7744-454c-80d9-31c671657fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:16.123055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1387/2798] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:16.127216 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aec82c-1d1a-45cd-bfd5-740bcea19e9e None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.137592 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aec82c-1d1a-45cd-bfd5-740bcea19e9e None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:16.142311 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20ade1-a7da-4d4b-9f2c-c6e28e80a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:16.142961 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20ade1-a7da-4d4b-9f2c-c6e28e80a496 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.143238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20ade1-a7da-4d4b-9f2c-c6e28e80a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.143509 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20ade1-a7da-4d4b-9f2c-c6e28e80a496 admin admin] PATH_INFO: `/v3/domains` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.144231 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20ade1-a7da-4d4b-9f2c-c6e28e80a496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80179) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:16.144534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20ade1-a7da-4d4b-9f2c-c6e28e80a496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:16.146136 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20ade1-a7da-4d4b-9f2c-c6e28e80a496 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:16.157884 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1412/2799] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:27:16.162039 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32d925-7744-454c-80d9-31c671657fd1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.171067 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32d925-7744-454c-80d9-31c671657fd1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:16.175678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaadc1-2c53-416c-a2b5-c0a92222d33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:16.176345 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaadc1-2c53-416c-a2b5-c0a92222d33b admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.176626 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaadc1-2c53-416c-a2b5-c0a92222d33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.176897 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaadc1-2c53-416c-a2b5-c0a92222d33b admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.177578 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaadc1-2c53-416c-a2b5-c0a92222d33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:16.179509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaadc1-2c53-416c-a2b5-c0a92222d33b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:16.259913 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1388/2800] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:27:16 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:16.264061 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20ade1-a7da-4d4b-9f2c-c6e28e80a496 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.274245 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20ade1-a7da-4d4b-9f2c-c6e28e80a496 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:16.328293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5301-a78b-4821-8388-3288e7534ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:16.328953 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5301-a78b-4821-8388-3288e7534ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.329233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5301-a78b-4821-8388-3288e7534ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.329507 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5301-a78b-4821-8388-3288e7534ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.330255 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5301-a78b-4821-8388-3288e7534ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:16.332230 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5301-a78b-4821-8388-3288e7534ee7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:16.442605 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1413/2801] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:27:16 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:16.447120 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaadc1-2c53-416c-a2b5-c0a92222d33b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.457008 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaadc1-2c53-416c-a2b5-c0a92222d33b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:16.461589 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ace42-f7a9-4265-a94f-07340e56e1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:16.462272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ace42-f7a9-4265-a94f-07340e56e1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.462553 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ace42-f7a9-4265-a94f-07340e56e1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.462823 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ace42-f7a9-4265-a94f-07340e56e1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.463545 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ace42-f7a9-4265-a94f-07340e56e1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:16.465406 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ace42-f7a9-4265-a94f-07340e56e1e1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:16.475580 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1389/2802] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:16.479471 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5301-a78b-4821-8388-3288e7534ee7 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.489217 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5301-a78b-4821-8388-3288e7534ee7 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:16.494272 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd9f86-83e9-4de3-b496-023c6510fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:16.494912 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9f86-83e9-4de3-b496-023c6510fe37 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.495186 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9f86-83e9-4de3-b496-023c6510fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.495453 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9f86-83e9-4de3-b496-023c6510fe37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.496198 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd9f86-83e9-4de3-b496-023c6510fe37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:16.497763 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd9f86-83e9-4de3-b496-023c6510fe37 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:16.507201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1414/2803] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:16.511814 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ace42-f7a9-4265-a94f-07340e56e1e1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.521452 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ace42-f7a9-4265-a94f-07340e56e1e1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:16.525983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b36cc-03e8-489f-b822-89550b846e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:16.526873 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b36cc-03e8-489f-b822-89550b846e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.527157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b36cc-03e8-489f-b822-89550b846e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.527428 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b36cc-03e8-489f-b822-89550b846e93 admin admin] PATH_INFO: `/v3/projects/da04f412bf27439d98ac9e62e8dc8676/users/5702a76b1e724b56b774ef15bdf889a1/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.541142 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b36cc-03e8-489f-b822-89550b846e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da04f412bf27439d98ac9e62e8dc8676, user_id=5702a76b1e724b56b774ef15bdf889a1, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:16.543818 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b36cc-03e8-489f-b822-89550b846e93 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:16.619158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1390/2804] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:16 2022] PUT /identity/v3/projects/da04f412bf27439d98ac9e62e8dc8676/users/5702a76b1e724b56b774ef15bdf889a1/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:16.629201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b8d53-df2f-4ecf-8f80-9a5353d27563 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.632715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b8d53-df2f-4ecf-8f80-9a5353d27563 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.632715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b8d53-df2f-4ecf-8f80-9a5353d27563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.656086 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-615b8d53-df2f-4ecf-8f80-9a5353d27563 None None] MFA Rules not processed for user `5702a76b1e724b56b774ef15bdf889a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:16.657268 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-615b8d53-df2f-4ecf-8f80-9a5353d27563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:16.716816 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1415/2805] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:16.721158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b36cc-03e8-489f-b822-89550b846e93 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.779266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b36cc-03e8-489f-b822-89550b846e93 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:16.783987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958442e0-3dcb-45c4-bd58-7e3b5a1bc617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:16.784623 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958442e0-3dcb-45c4-bd58-7e3b5a1bc617 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.784926 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958442e0-3dcb-45c4-bd58-7e3b5a1bc617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.785200 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958442e0-3dcb-45c4-bd58-7e3b5a1bc617 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.785892 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958442e0-3dcb-45c4-bd58-7e3b5a1bc617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:16.787819 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958442e0-3dcb-45c4-bd58-7e3b5a1bc617 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:16.872419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1391/2806] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:27:16 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:16.876162 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b8d53-df2f-4ecf-8f80-9a5353d27563 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:16.886623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b8d53-df2f-4ecf-8f80-9a5353d27563 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:16.940467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb805-8e41-4458-b22b-d76d69d52a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:16.941133 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb805-8e41-4458-b22b-d76d69d52a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:16.941415 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb805-8e41-4458-b22b-d76d69d52a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:16.941689 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bb805-8e41-4458-b22b-d76d69d52a4a admin admin] PATH_INFO: `/v3/users` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:16.942415 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb805-8e41-4458-b22b-d76d69d52a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:16.944315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bb805-8e41-4458-b22b-d76d69d52a4a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.036630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1416/2807] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:27:16 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:17.041058 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958442e0-3dcb-45c4-bd58-7e3b5a1bc617 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.051232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958442e0-3dcb-45c4-bd58-7e3b5a1bc617 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.055750 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f84aa3-090e-45d2-befa-6c7cd248bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.056983 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f84aa3-090e-45d2-befa-6c7cd248bb8b admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.057260 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f84aa3-090e-45d2-befa-6c7cd248bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.057550 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f84aa3-090e-45d2-befa-6c7cd248bb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.058305 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f84aa3-090e-45d2-befa-6c7cd248bb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.059881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f84aa3-090e-45d2-befa-6c7cd248bb8b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.071157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1392/2808] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:17.075070 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb805-8e41-4458-b22b-d76d69d52a4a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.085164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bb805-8e41-4458-b22b-d76d69d52a4a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.090522 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce1593-41c8-449f-9650-acbc5afc0985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.091387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce1593-41c8-449f-9650-acbc5afc0985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.091669 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce1593-41c8-449f-9650-acbc5afc0985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.091943 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce1593-41c8-449f-9650-acbc5afc0985 admin admin] PATH_INFO: `/v3/projects/4994cff66cc1412bb15b3177fb950bd2/users/05bbd8045e404fd6b3e2b652ccc0ef84/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.106722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce1593-41c8-449f-9650-acbc5afc0985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4994cff66cc1412bb15b3177fb950bd2, user_id=05bbd8045e404fd6b3e2b652ccc0ef84, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.109403 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce1593-41c8-449f-9650-acbc5afc0985 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.189417 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1417/2809] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:17 2022] PUT /identity/v3/projects/4994cff66cc1412bb15b3177fb950bd2/users/05bbd8045e404fd6b3e2b652ccc0ef84/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:17.193430 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f84aa3-090e-45d2-befa-6c7cd248bb8b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.203255 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f84aa3-090e-45d2-befa-6c7cd248bb8b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.258184 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb00ba5-ccff-437b-8e5c-c7ba20a30464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.258764 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00ba5-ccff-437b-8e5c-c7ba20a30464 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.259077 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00ba5-ccff-437b-8e5c-c7ba20a30464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.259351 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00ba5-ccff-437b-8e5c-c7ba20a30464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.260071 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb00ba5-ccff-437b-8e5c-c7ba20a30464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.261736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb00ba5-ccff-437b-8e5c-c7ba20a30464 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.271585 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1393/2810] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:17.276138 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce1593-41c8-449f-9650-acbc5afc0985 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.286275 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce1593-41c8-449f-9650-acbc5afc0985 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.291572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa9a8d-90b9-464b-a585-4ed06273d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.292436 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa9a8d-90b9-464b-a585-4ed06273d503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.292702 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa9a8d-90b9-464b-a585-4ed06273d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.292975 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa9a8d-90b9-464b-a585-4ed06273d503 admin admin] PATH_INFO: `/v3/projects/4994cff66cc1412bb15b3177fb950bd2/users/05bbd8045e404fd6b3e2b652ccc0ef84/roles/042169a166e14a80beac826291ceaf73` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.294974 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa9a8d-90b9-464b-a585-4ed06273d503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4994cff66cc1412bb15b3177fb950bd2, user_id=05bbd8045e404fd6b3e2b652ccc0ef84, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.297594 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa9a8d-90b9-464b-a585-4ed06273d503 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.307832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1418/2811] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:17 2022] PUT /identity/v3/projects/4994cff66cc1412bb15b3177fb950bd2/users/05bbd8045e404fd6b3e2b652ccc0ef84/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:17.319063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323cfc6-edb2-4560-9eb7-d8d30fc8a686 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.319352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323cfc6-edb2-4560-9eb7-d8d30fc8a686 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.319664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323cfc6-edb2-4560-9eb7-d8d30fc8a686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.345931 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0323cfc6-edb2-4560-9eb7-d8d30fc8a686 None None] MFA Rules not processed for user `05bbd8045e404fd6b3e2b652ccc0ef84`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:17.347158 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0323cfc6-edb2-4560-9eb7-d8d30fc8a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:17.412546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1394/2812] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:17.425390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa9a8d-90b9-464b-a585-4ed06273d503 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:17.427097 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6aaa9a8d-90b9-464b-a585-4ed06273d503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:17.502188 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa9a8d-90b9-464b-a585-4ed06273d503 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:17.505832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd1e78-d81a-47ba-94e7-40b76b7ac618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:17.506525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd1e78-d81a-47ba-94e7-40b76b7ac618 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:17.506804 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd1e78-d81a-47ba-94e7-40b76b7ac618 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:17.507076 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd1e78-d81a-47ba-94e7-40b76b7ac618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:17.516280 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd1e78-d81a-47ba-94e7-40b76b7ac618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:17.517693 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd1e78-d81a-47ba-94e7-40b76b7ac618 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:17.527387 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1419/2813] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:18.268908 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323cfc6-edb2-4560-9eb7-d8d30fc8a686 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:18.277975 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323cfc6-edb2-4560-9eb7-d8d30fc8a686 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:18.282607 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce6940-4d7a-41b0-b57f-de30e8cb000c tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05bbd8045e404fd6b3e2b652ccc0ef84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4994cff66cc1412bb15b3177fb950bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:18.283256 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce6940-4d7a-41b0-b57f-de30e8cb000c tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:18.283543 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce6940-4d7a-41b0-b57f-de30e8cb000c tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:18.283830 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce6940-4d7a-41b0-b57f-de30e8cb000c tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:18.284591 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce6940-4d7a-41b0-b57f-de30e8cb000c tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:18.284919 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce6940-4d7a-41b0-b57f-de30e8cb000c tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:18.286538 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce6940-4d7a-41b0-b57f-de30e8cb000c tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:18.298638 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1395/2814] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:27:18.302598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd1e78-d81a-47ba-94e7-40b76b7ac618 service cinder] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:18.312262 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd1e78-d81a-47ba-94e7-40b76b7ac618 service cinder] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:18.316821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642d68-7c8a-4848-bab2-c5eef192bbb0 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05bbd8045e404fd6b3e2b652ccc0ef84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4994cff66cc1412bb15b3177fb950bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:18.317462 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642d68-7c8a-4848-bab2-c5eef192bbb0 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:18.317741 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642d68-7c8a-4848-bab2-c5eef192bbb0 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:18.318014 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642d68-7c8a-4848-bab2-c5eef192bbb0 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:18.318732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66642d68-7c8a-4848-bab2-c5eef192bbb0 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:18.320612 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66642d68-7c8a-4848-bab2-c5eef192bbb0 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:18.432539 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1420/2815] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:27:18 2022] POST /identity/v3/projects => generated 354 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:18.436515 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce6940-4d7a-41b0-b57f-de30e8cb000c tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:18.446548 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce6940-4d7a-41b0-b57f-de30e8cb000c tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:18.501108 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05bbd8045e404fd6b3e2b652ccc0ef84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4994cff66cc1412bb15b3177fb950bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:18.501693 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:18.501970 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:18.502291 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:18.503003 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:18.503310 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:18.504889 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:18.515952 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1396/2816] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:27:18.550720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642d68-7c8a-4848-bab2-c5eef192bbb0 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:18.561321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642d68-7c8a-4848-bab2-c5eef192bbb0 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:18.565806 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05bbd8045e404fd6b3e2b652ccc0ef84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4994cff66cc1412bb15b3177fb950bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:18.566706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:18.566984 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:18.567252 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] PATH_INFO: `/v3/projects/bf7c0e0aff76404eb7cec08be48c281a` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:18.568435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf7c0e0aff76404eb7cec08be48c281a)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:18.570342 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:18.691050 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7c0e0aff76404eb7cec08be48c281a', 'request_id': 'req-d96e92bb-bc15-4828-8f43-f19f996d3b4d'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.749414 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7c0e0aff76404eb7cec08be48c281a', 'request_id': 'req-d96e92bb-bc15-4828-8f43-f19f996d3b4d'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.754911 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7c0e0aff76404eb7cec08be48c281a', 'request_id': 'req-d96e92bb-bc15-4828-8f43-f19f996d3b4d'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.765843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] The token cache is being invalidate because project bf7c0e0aff76404eb7cec08be48c281a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:18.766154 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.766820 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-d96e92bb-bc15-4828-8f43-f19f996d3b4d tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:18.768321 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1421/2817] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:18 2022] DELETE /identity/v3/projects/bf7c0e0aff76404eb7cec08be48c281a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:19.319323 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:19.321048 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:19.383433 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135feb-53df-40c2-9f51-67098874afc8 tempest-VolumeQuotaClassesTest-321140915 tempest-VolumeQuotaClassesTest-321140915-project-admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:19.436878 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:19.437735 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:19.438017 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:19.438330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] PATH_INFO: `/v3/users/5702a76b1e724b56b774ef15bdf889a1` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:19.439519 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5702a76b1e724b56b774ef15bdf889a1)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:19.441420 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:19.622004 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5702a76b1e724b56b774ef15bdf889a1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.622683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5702a76b1e724b56b774ef15bdf889a1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.634678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5702a76b1e724b56b774ef15bdf889a1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.635244 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5702a76b1e724b56b774ef15bdf889a1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.641669 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5702a76b1e724b56b774ef15bdf889a1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:19.688061 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1397/2818] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:27:19 2022] DELETE /identity/v3/users/5702a76b1e724b56b774ef15bdf889a1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:19.692598 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162dad5-951f-44ad-840b-b90f945cb746 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:19.693108 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162dad5-951f-44ad-840b-b90f945cb746 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:19.693222 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162dad5-951f-44ad-840b-b90f945cb746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:19.709995 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-6162dad5-951f-44ad-840b-b90f945cb746 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:19.711196 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6162dad5-951f-44ad-840b-b90f945cb746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:19.766636 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1422/2819] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:19.776183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:19.777562 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:19.844223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee2207-1cf0-4e3a-8ddd-276a44108448 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:19.847849 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b54279-faef-44db-a854-911428022762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:19.848488 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b54279-faef-44db-a854-911428022762 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:19.848771 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b54279-faef-44db-a854-911428022762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:19.849045 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b54279-faef-44db-a854-911428022762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:19.858419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b54279-faef-44db-a854-911428022762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:19.859850 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b54279-faef-44db-a854-911428022762 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:19.869633 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1398/2820] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:20.227144 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162dad5-951f-44ad-840b-b90f945cb746 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.229296 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-6162dad5-951f-44ad-840b-b90f945cb746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:20.241283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162dad5-951f-44ad-840b-b90f945cb746 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.245952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.246832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.247135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.247409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] PATH_INFO: `/v3/projects/da04f412bf27439d98ac9e62e8dc8676` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.248623 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da04f412bf27439d98ac9e62e8dc8676)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.250555 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.343653 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da04f412bf27439d98ac9e62e8dc8676', 'request_id': 'req-3f06e074-eabd-4556-a1f6-467f87190d75'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.406556 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da04f412bf27439d98ac9e62e8dc8676', 'request_id': 'req-3f06e074-eabd-4556-a1f6-467f87190d75'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.411964 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da04f412bf27439d98ac9e62e8dc8676', 'request_id': 'req-3f06e074-eabd-4556-a1f6-467f87190d75'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.423357 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] The token cache is being invalidate because project da04f412bf27439d98ac9e62e8dc8676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:20.423663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.424292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.425863 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1423/2821] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:20 2022] DELETE /identity/v3/projects/da04f412bf27439d98ac9e62e8dc8676 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:20.429738 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b54279-faef-44db-a854-911428022762 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:20.439019 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b54279-faef-44db-a854-911428022762 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:20.494341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:20.494341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:20.494341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:20.494341 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] PATH_INFO: `/v3/users/05bbd8045e404fd6b3e2b652ccc0ef84` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:20.495501 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05bbd8045e404fd6b3e2b652ccc0ef84)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:20.497408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:20.656179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05bbd8045e404fd6b3e2b652ccc0ef84'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.656862 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05bbd8045e404fd6b3e2b652ccc0ef84'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.668241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05bbd8045e404fd6b3e2b652ccc0ef84'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.668869 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05bbd8045e404fd6b3e2b652ccc0ef84'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.675450 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b1b5a256-b8ca-49bc-be49-e1dc286c629c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05bbd8045e404fd6b3e2b652ccc0ef84'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:20.750740 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1399/2822] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:27:20 2022] DELETE /identity/v3/users/05bbd8045e404fd6b3e2b652ccc0ef84 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:21.135259 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:21.136739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:21.149540 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06e074-eabd-4556-a1f6-467f87190d75 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:21.205760 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:21.206648 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.206945 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.207210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] PATH_INFO: `/v3/projects/4994cff66cc1412bb15b3177fb950bd2` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.208382 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4994cff66cc1412bb15b3177fb950bd2)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:21.210312 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:21.316033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4994cff66cc1412bb15b3177fb950bd2', 'request_id': 'req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:21.377958 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4994cff66cc1412bb15b3177fb950bd2', 'request_id': 'req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:21.383501 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4994cff66cc1412bb15b3177fb950bd2', 'request_id': 'req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:21.394235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] The token cache is being invalidate because project 4994cff66cc1412bb15b3177fb950bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:21.394539 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:21.395148 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-a71a7ac0-593d-4c98-a53b-6ce98e1e6df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:21.396683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1424/2823] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:21 2022] DELETE /identity/v3/projects/4994cff66cc1412bb15b3177fb950bd2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:21.401667 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b137e1-e3e9-4912-915e-647337617f43 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.401958 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b137e1-e3e9-4912-915e-647337617f43 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.402263 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b137e1-e3e9-4912-915e-647337617f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.420330 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-47b137e1-e3e9-4912-915e-647337617f43 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:21.421518 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-47b137e1-e3e9-4912-915e-647337617f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:21.479509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1400/2824] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:21.487233 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a14e0-a4f9-4cd5-a2f8-c273037eb228 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.487522 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a14e0-a4f9-4cd5-a2f8-c273037eb228 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.487796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a14e0-a4f9-4cd5-a2f8-c273037eb228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.505928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-7a9a14e0-a4f9-4cd5-a2f8-c273037eb228 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:21.507141 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7a9a14e0-a4f9-4cd5-a2f8-c273037eb228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:21.515088 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1425/2825] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:21.519076 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b137e1-e3e9-4912-915e-647337617f43 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:21.528530 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b137e1-e3e9-4912-915e-647337617f43 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:21.533026 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd34ad7-6176-46ba-8c91-3c9f4ca76f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:21.533668 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd34ad7-6176-46ba-8c91-3c9f4ca76f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.533947 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd34ad7-6176-46ba-8c91-3c9f4ca76f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.534253 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd34ad7-6176-46ba-8c91-3c9f4ca76f0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.534965 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd34ad7-6176-46ba-8c91-3c9f4ca76f0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:21.535268 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd34ad7-6176-46ba-8c91-3c9f4ca76f0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:21.536853 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd34ad7-6176-46ba-8c91-3c9f4ca76f0f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:21.548376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1401/2826] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 15:27:21.552315 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a14e0-a4f9-4cd5-a2f8-c273037eb228 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:21.561699 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a14e0-a4f9-4cd5-a2f8-c273037eb228 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:21.566455 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3411c-3d28-48de-ad71-210ceb93b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:21.567033 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3411c-3d28-48de-ad71-210ceb93b8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.567313 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3411c-3d28-48de-ad71-210ceb93b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.567585 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3411c-3d28-48de-ad71-210ceb93b8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.568277 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3411c-3d28-48de-ad71-210ceb93b8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:21.570184 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3411c-3d28-48de-ad71-210ceb93b8d5 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:21.655173 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1426/2827] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:27:21 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:21.659171 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd34ad7-6176-46ba-8c91-3c9f4ca76f0f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:21.669647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd34ad7-6176-46ba-8c91-3c9f4ca76f0f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:21.723529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92664df-b053-45b2-8eae-54292db31a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:21.724180 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92664df-b053-45b2-8eae-54292db31a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.724460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92664df-b053-45b2-8eae-54292db31a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.724732 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92664df-b053-45b2-8eae-54292db31a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.725441 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92664df-b053-45b2-8eae-54292db31a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:21.727392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92664df-b053-45b2-8eae-54292db31a4c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:21.823636 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1402/2828] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:27:21 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:27:21.827798 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3411c-3d28-48de-ad71-210ceb93b8d5 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:21.838672 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3411c-3d28-48de-ad71-210ceb93b8d5 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:21.843534 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd187f5-b782-4516-9164-ad5434a281b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:21.844176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd187f5-b782-4516-9164-ad5434a281b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.844453 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd187f5-b782-4516-9164-ad5434a281b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.844722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd187f5-b782-4516-9164-ad5434a281b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.845435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd187f5-b782-4516-9164-ad5434a281b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:21.847135 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd187f5-b782-4516-9164-ad5434a281b6 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:21.857698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1427/2829] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:21.861609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92664df-b053-45b2-8eae-54292db31a4c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:21.871358 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92664df-b053-45b2-8eae-54292db31a4c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:21.876013 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a9cda-085b-4b08-ae9b-0cf131f15347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:21.876655 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a9cda-085b-4b08-ae9b-0cf131f15347 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.876935 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a9cda-085b-4b08-ae9b-0cf131f15347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.877209 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a9cda-085b-4b08-ae9b-0cf131f15347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.877928 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a9cda-085b-4b08-ae9b-0cf131f15347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:21.879551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a9cda-085b-4b08-ae9b-0cf131f15347 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:21.889319 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1403/2830] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:21.893326 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd187f5-b782-4516-9164-ad5434a281b6 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:21.903480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd187f5-b782-4516-9164-ad5434a281b6 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:21.908021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3298-f827-4c6e-b851-17066808b5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:21.908907 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3298-f827-4c6e-b851-17066808b5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:21.909185 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3298-f827-4c6e-b851-17066808b5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:21.909484 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3298-f827-4c6e-b851-17066808b5fa admin admin] PATH_INFO: `/v3/projects/5cae7a74ae6a41c68e1e9ae44e5005ba/users/11903670271843659052139658f71e34/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:21.924017 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd3298-f827-4c6e-b851-17066808b5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cae7a74ae6a41c68e1e9ae44e5005ba, user_id=11903670271843659052139658f71e34, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:21.926734 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd3298-f827-4c6e-b851-17066808b5fa admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:22.000799 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1428/2831] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:21 2022] PUT /identity/v3/projects/5cae7a74ae6a41c68e1e9ae44e5005ba/users/11903670271843659052139658f71e34/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:22.011920 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1942e2-3673-4ca7-b74c-087bd8539549 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:22.012207 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1942e2-3673-4ca7-b74c-087bd8539549 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:22.012477 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1942e2-3673-4ca7-b74c-087bd8539549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:22.038893 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8f1942e2-3673-4ca7-b74c-087bd8539549 None None] MFA Rules not processed for user `11903670271843659052139658f71e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:22.040086 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8f1942e2-3673-4ca7-b74c-087bd8539549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:22.101407 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1404/2832] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:22.105771 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3298-f827-4c6e-b851-17066808b5fa admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:22.165610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3298-f827-4c6e-b851-17066808b5fa admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:22.170399 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d2d7-a912-404f-a980-e121f989922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:22.171056 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d2d7-a912-404f-a980-e121f989922f admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:22.171337 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d2d7-a912-404f-a980-e121f989922f admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:22.171611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d2d7-a912-404f-a980-e121f989922f admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:22.172308 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d2d7-a912-404f-a980-e121f989922f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:22.174292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d2d7-a912-404f-a980-e121f989922f admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:22.279715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1429/2833] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:27:22 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:22.283832 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1942e2-3673-4ca7-b74c-087bd8539549 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:22.294382 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1942e2-3673-4ca7-b74c-087bd8539549 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:22.347990 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa02b4-9e54-4aac-a7d2-8abb0f7ea747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:22.348581 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa02b4-9e54-4aac-a7d2-8abb0f7ea747 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:22.348865 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa02b4-9e54-4aac-a7d2-8abb0f7ea747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:22.349136 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa02b4-9e54-4aac-a7d2-8abb0f7ea747 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:22.349809 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa02b4-9e54-4aac-a7d2-8abb0f7ea747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:22.351745 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa02b4-9e54-4aac-a7d2-8abb0f7ea747 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:22.448797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1405/2834] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:27:22 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:27:22.452698 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d2d7-a912-404f-a980-e121f989922f admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:22.462829 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d2d7-a912-404f-a980-e121f989922f admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:22.467642 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514ba0e-735a-44ed-9385-86250bb9aa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:22.468292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514ba0e-735a-44ed-9385-86250bb9aa99 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:22.468572 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514ba0e-735a-44ed-9385-86250bb9aa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:22.468844 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514ba0e-735a-44ed-9385-86250bb9aa99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:22.469570 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514ba0e-735a-44ed-9385-86250bb9aa99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:22.471200 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514ba0e-735a-44ed-9385-86250bb9aa99 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:22.482343 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1430/2835] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:22.486266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa02b4-9e54-4aac-a7d2-8abb0f7ea747 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:22.496385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa02b4-9e54-4aac-a7d2-8abb0f7ea747 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:22.500899 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d96eb1-9a29-47eb-ae60-2c10f693c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:22.501749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d96eb1-9a29-47eb-ae60-2c10f693c642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:22.502023 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d96eb1-9a29-47eb-ae60-2c10f693c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:22.502324 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d96eb1-9a29-47eb-ae60-2c10f693c642 admin admin] PATH_INFO: `/v3/projects/18c64ffe0aa14cc88bd13944742413c9/users/15535be2e3a74781a4bf1a9fa5f9bfa9/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:22.516909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d96eb1-9a29-47eb-ae60-2c10f693c642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c64ffe0aa14cc88bd13944742413c9, user_id=15535be2e3a74781a4bf1a9fa5f9bfa9, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:22.519558 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d96eb1-9a29-47eb-ae60-2c10f693c642 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:22.607939 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1406/2836] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:22 2022] PUT /identity/v3/projects/18c64ffe0aa14cc88bd13944742413c9/users/15535be2e3a74781a4bf1a9fa5f9bfa9/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 15:27:22.611928 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514ba0e-735a-44ed-9385-86250bb9aa99 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:22.622292 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514ba0e-735a-44ed-9385-86250bb9aa99 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:22.677796 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba8f19-fd99-447a-9c77-4f97408e836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:22.678496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba8f19-fd99-447a-9c77-4f97408e836a admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:22.678824 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba8f19-fd99-447a-9c77-4f97408e836a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:22.679100 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba8f19-fd99-447a-9c77-4f97408e836a admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:22.679850 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba8f19-fd99-447a-9c77-4f97408e836a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:22.682205 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba8f19-fd99-447a-9c77-4f97408e836a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:22.691998 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1431/2837] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:22.696097 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d96eb1-9a29-47eb-ae60-2c10f693c642 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:22.706213 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d96eb1-9a29-47eb-ae60-2c10f693c642 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:22.710827 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca455c46-caf2-4996-997f-5a5fce3ad6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:22.711709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca455c46-caf2-4996-997f-5a5fce3ad6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:22.711995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca455c46-caf2-4996-997f-5a5fce3ad6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:22.712260 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca455c46-caf2-4996-997f-5a5fce3ad6e3 admin admin] PATH_INFO: `/v3/projects/18c64ffe0aa14cc88bd13944742413c9/users/15535be2e3a74781a4bf1a9fa5f9bfa9/roles/042169a166e14a80beac826291ceaf73` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:22.714272 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca455c46-caf2-4996-997f-5a5fce3ad6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c64ffe0aa14cc88bd13944742413c9, user_id=15535be2e3a74781a4bf1a9fa5f9bfa9, role_id=042169a166e14a80beac826291ceaf73)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:22.717462 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca455c46-caf2-4996-997f-5a5fce3ad6e3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:22.728175 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1407/2838] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:22 2022] PUT /identity/v3/projects/18c64ffe0aa14cc88bd13944742413c9/users/15535be2e3a74781a4bf1a9fa5f9bfa9/roles/042169a166e14a80beac826291ceaf73 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:22.739480 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763981-6266-46db-a59c-0e8e075c6bd8 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:22.739843 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763981-6266-46db-a59c-0e8e075c6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:22.740250 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763981-6266-46db-a59c-0e8e075c6bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:22.767818 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-92763981-6266-46db-a59c-0e8e075c6bd8 None None] MFA Rules not processed for user `15535be2e3a74781a4bf1a9fa5f9bfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:22.769030 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-92763981-6266-46db-a59c-0e8e075c6bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:22.835638 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1432/2839] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:22.846936 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca455c46-caf2-4996-997f-5a5fce3ad6e3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:22.848635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ca455c46-caf2-4996-997f-5a5fce3ad6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:22.904471 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca455c46-caf2-4996-997f-5a5fce3ad6e3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:22.908225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8931ab-e10f-4416-b246-2e371ade1fc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:22.908863 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8931ab-e10f-4416-b246-2e371ade1fc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:22.909143 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8931ab-e10f-4416-b246-2e371ade1fc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:22.909439 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8931ab-e10f-4416-b246-2e371ade1fc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:22.963510 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8931ab-e10f-4416-b246-2e371ade1fc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:22.965201 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8931ab-e10f-4416-b246-2e371ade1fc8 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:22.973838 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1408/2840] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:27.980992 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92763981-6266-46db-a59c-0e8e075c6bd8 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:27.982441 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-92763981-6266-46db-a59c-0e8e075c6bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:27.993920 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92763981-6266-46db-a59c-0e8e075c6bd8 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:27.997396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd142d-2f48-4ed2-8ce3-207a39973662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:27.998023 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd142d-2f48-4ed2-8ce3-207a39973662 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:27.998336 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd142d-2f48-4ed2-8ce3-207a39973662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:27.998608 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd142d-2f48-4ed2-8ce3-207a39973662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:28.007825 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd142d-2f48-4ed2-8ce3-207a39973662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:28.009777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd142d-2f48-4ed2-8ce3-207a39973662 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:28.019018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1433/2841] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:33.717724 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8931ab-e10f-4416-b246-2e371ade1fc8 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:33.776352 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8931ab-e10f-4416-b246-2e371ade1fc8 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:33.780864 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:33.781709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:33.781989 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:33.782289 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] PATH_INFO: `/v3/users/11903670271843659052139658f71e34` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:33.783460 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=11903670271843659052139658f71e34)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:33.785380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:33.970015 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11903670271843659052139658f71e34'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:33.970637 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11903670271843659052139658f71e34'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:33.982497 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11903670271843659052139658f71e34'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:33.983117 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11903670271843659052139658f71e34'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:33.989881 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11903670271843659052139658f71e34'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.042642 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1409/2842] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:27:33 2022] DELETE /identity/v3/users/11903670271843659052139658f71e34 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:34.047234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013ef5c-a9eb-4b48-84d8-e4f6594633bd None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.047715 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013ef5c-a9eb-4b48-84d8-e4f6594633bd None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.047830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013ef5c-a9eb-4b48-84d8-e4f6594633bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.065314 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3013ef5c-a9eb-4b48-84d8-e4f6594633bd None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:34.066525 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3013ef5c-a9eb-4b48-84d8-e4f6594633bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:34.122072 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1434/2843] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:34.131529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.132918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:34.187063 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfb8ea-f41c-43ee-ac70-9ee5a3b7a7dd admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.190690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd9244-8ff1-4751-b662-ed42de1d0f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.191321 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd9244-8ff1-4751-b662-ed42de1d0f7f service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.191598 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd9244-8ff1-4751-b662-ed42de1d0f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.191866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd9244-8ff1-4751-b662-ed42de1d0f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.200549 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd9244-8ff1-4751-b662-ed42de1d0f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.201968 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd9244-8ff1-4751-b662-ed42de1d0f7f service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.211367 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1410/2844] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:34.593215 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013ef5c-a9eb-4b48-84d8-e4f6594633bd None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.594657 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3013ef5c-a9eb-4b48-84d8-e4f6594633bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:34.607381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013ef5c-a9eb-4b48-84d8-e4f6594633bd None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.611913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.614421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.614421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.614421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] PATH_INFO: `/v3/projects/5cae7a74ae6a41c68e1e9ae44e5005ba` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.614778 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cae7a74ae6a41c68e1e9ae44e5005ba)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.616752 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:34.717305 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cae7a74ae6a41c68e1e9ae44e5005ba', 'request_id': 'req-7f7f86af-31fa-459c-ac42-267da1f44ea1'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.785950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cae7a74ae6a41c68e1e9ae44e5005ba', 'request_id': 'req-7f7f86af-31fa-459c-ac42-267da1f44ea1'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.791435 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cae7a74ae6a41c68e1e9ae44e5005ba', 'request_id': 'req-7f7f86af-31fa-459c-ac42-267da1f44ea1'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.802650 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] The token cache is being invalidate because project 5cae7a74ae6a41c68e1e9ae44e5005ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:34.807932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.807932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:34.807932 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1435/2845] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:34 2022] DELETE /identity/v3/projects/5cae7a74ae6a41c68e1e9ae44e5005ba => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:34.809701 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd9244-8ff1-4751-b662-ed42de1d0f7f service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:34.819202 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd9244-8ff1-4751-b662-ed42de1d0f7f service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:34.873055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:34.873842 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:34.874157 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:34.874432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] PATH_INFO: `/v3/users/15535be2e3a74781a4bf1a9fa5f9bfa9` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:34.875603 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=15535be2e3a74781a4bf1a9fa5f9bfa9)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:34.877505 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:35.033087 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15535be2e3a74781a4bf1a9fa5f9bfa9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.033730 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15535be2e3a74781a4bf1a9fa5f9bfa9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.045599 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15535be2e3a74781a4bf1a9fa5f9bfa9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.046271 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15535be2e3a74781a4bf1a9fa5f9bfa9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.052709 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-adc9fcdc-45e3-473c-8c73-05b7362fd13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15535be2e3a74781a4bf1a9fa5f9bfa9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.126940 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1411/2846] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:27:34 2022] DELETE /identity/v3/users/15535be2e3a74781a4bf1a9fa5f9bfa9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:35.501994 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:35.503468 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.516520 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f86af-31fa-459c-ac42-267da1f44ea1 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:35.570085 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:35.570924 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.571212 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.571466 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] PATH_INFO: `/v3/projects/18c64ffe0aa14cc88bd13944742413c9` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.572614 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c64ffe0aa14cc88bd13944742413c9)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:35.575032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:35.709489 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c64ffe0aa14cc88bd13944742413c9', 'request_id': 'req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.778448 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c64ffe0aa14cc88bd13944742413c9', 'request_id': 'req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.783902 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c64ffe0aa14cc88bd13944742413c9', 'request_id': 'req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.794791 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] The token cache is being invalidate because project 18c64ffe0aa14cc88bd13944742413c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:35.795074 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.795720 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-5ab6f4a0-c6aa-451b-9742-e88f2e8de21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:35.797392 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1436/2847] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:35 2022] DELETE /identity/v3/projects/18c64ffe0aa14cc88bd13944742413c9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:35.803500 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e66a-274c-4f83-bec0-713ad9f296ce None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.803736 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e66a-274c-4f83-bec0-713ad9f296ce None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.804012 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4e66a-274c-4f83-bec0-713ad9f296ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.821866 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-76d4e66a-274c-4f83-bec0-713ad9f296ce None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:35.823705 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-76d4e66a-274c-4f83-bec0-713ad9f296ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.880183 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1412/2848] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:35.889122 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c16a3-41ba-4cec-811c-112708c049ef None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.889409 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c16a3-41ba-4cec-811c-112708c049ef None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.889687 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c16a3-41ba-4cec-811c-112708c049ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.907560 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-5a6c16a3-41ba-4cec-811c-112708c049ef None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:35.908745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-5a6c16a3-41ba-4cec-811c-112708c049ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:35.916630 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1437/2849] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:35.920699 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e66a-274c-4f83-bec0-713ad9f296ce None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:35.930240 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4e66a-274c-4f83-bec0-713ad9f296ce None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:35.935275 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28916-7e91-426b-af11-b05aa3c5aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:35.935923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28916-7e91-426b-af11-b05aa3c5aba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.936208 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28916-7e91-426b-af11-b05aa3c5aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.936489 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28916-7e91-426b-af11-b05aa3c5aba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.937242 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28916-7e91-426b-af11-b05aa3c5aba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:35.937551 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28916-7e91-426b-af11-b05aa3c5aba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:35.939228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28916-7e91-426b-af11-b05aa3c5aba6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:35.951370 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1413/2850] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:27:35.955460 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c16a3-41ba-4cec-811c-112708c049ef None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:35.964617 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c16a3-41ba-4cec-811c-112708c049ef None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:35.969426 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a011f12-77c8-49a1-8284-990bb94d3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:35.970077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011f12-77c8-49a1-8284-990bb94d3a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:35.970381 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011f12-77c8-49a1-8284-990bb94d3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:35.970655 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011f12-77c8-49a1-8284-990bb94d3a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:35.971351 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a011f12-77c8-49a1-8284-990bb94d3a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:35.973234 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a011f12-77c8-49a1-8284-990bb94d3a4b admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.060068 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1438/2851] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:27:35 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:36.064292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28916-7e91-426b-af11-b05aa3c5aba6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.074987 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28916-7e91-426b-af11-b05aa3c5aba6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.129092 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1b3e-2039-45a7-875d-bf87db23f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.129756 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1b3e-2039-45a7-875d-bf87db23f137 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.130036 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1b3e-2039-45a7-875d-bf87db23f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.130343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1b3e-2039-45a7-875d-bf87db23f137 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.131028 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1b3e-2039-45a7-875d-bf87db23f137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.132923 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1b3e-2039-45a7-875d-bf87db23f137 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.206609 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1414/2852] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:27:36 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:27:36.210651 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a011f12-77c8-49a1-8284-990bb94d3a4b admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.221093 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a011f12-77c8-49a1-8284-990bb94d3a4b admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.225952 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5eb6c-fff4-4c5c-ba3c-cb916c84f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.226646 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5eb6c-fff4-4c5c-ba3c-cb916c84f36a admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.226931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5eb6c-fff4-4c5c-ba3c-cb916c84f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.227204 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5eb6c-fff4-4c5c-ba3c-cb916c84f36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.227931 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5eb6c-fff4-4c5c-ba3c-cb916c84f36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.230105 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5eb6c-fff4-4c5c-ba3c-cb916c84f36a admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.240666 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1439/2853] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:36.244285 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1b3e-2039-45a7-875d-bf87db23f137 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.254664 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1b3e-2039-45a7-875d-bf87db23f137 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.259316 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be7d82-73d0-4a6f-842b-7301cc47d2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.259956 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be7d82-73d0-4a6f-842b-7301cc47d2df admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.260237 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be7d82-73d0-4a6f-842b-7301cc47d2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.260512 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be7d82-73d0-4a6f-842b-7301cc47d2df admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.261232 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be7d82-73d0-4a6f-842b-7301cc47d2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.262845 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be7d82-73d0-4a6f-842b-7301cc47d2df admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.272343 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1415/2854] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:36.276160 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5eb6c-fff4-4c5c-ba3c-cb916c84f36a admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.285637 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5eb6c-fff4-4c5c-ba3c-cb916c84f36a admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.290238 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3880c4-f655-479c-bb4b-0f2fb05448e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.291207 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3880c4-f655-479c-bb4b-0f2fb05448e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.291362 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3880c4-f655-479c-bb4b-0f2fb05448e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.292140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3880c4-f655-479c-bb4b-0f2fb05448e7 admin admin] PATH_INFO: `/v3/projects/54992d30c1254e95a12c132a978e89b1/users/461d8ec2e117485487b5a7bbb0bd07f5/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.305706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3880c4-f655-479c-bb4b-0f2fb05448e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54992d30c1254e95a12c132a978e89b1, user_id=461d8ec2e117485487b5a7bbb0bd07f5, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.309044 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3880c4-f655-479c-bb4b-0f2fb05448e7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.368091 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1440/2855] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:36 2022] PUT /identity/v3/projects/54992d30c1254e95a12c132a978e89b1/users/461d8ec2e117485487b5a7bbb0bd07f5/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:36.380937 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29698ea-7011-44ad-bf29-58ac8f0a1dec None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.381228 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29698ea-7011-44ad-bf29-58ac8f0a1dec None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.381504 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29698ea-7011-44ad-bf29-58ac8f0a1dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.407569 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e29698ea-7011-44ad-bf29-58ac8f0a1dec None None] MFA Rules not processed for user `461d8ec2e117485487b5a7bbb0bd07f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:36.408764 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e29698ea-7011-44ad-bf29-58ac8f0a1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:36.475859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1416/2856] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:36.487416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3880c4-f655-479c-bb4b-0f2fb05448e7 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.489116 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ca3880c4-f655-479c-bb4b-0f2fb05448e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:36.544535 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3880c4-f655-479c-bb4b-0f2fb05448e7 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.548210 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b4200-36c8-49eb-8688-e03fc33cebd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.548842 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b4200-36c8-49eb-8688-e03fc33cebd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.549119 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b4200-36c8-49eb-8688-e03fc33cebd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.549396 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b4200-36c8-49eb-8688-e03fc33cebd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.557408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b4200-36c8-49eb-8688-e03fc33cebd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.558849 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b4200-36c8-49eb-8688-e03fc33cebd1 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.567283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1441/2857] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:36.585686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29698ea-7011-44ad-bf29-58ac8f0a1dec None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:36.644995 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29698ea-7011-44ad-bf29-58ac8f0a1dec None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:36.649521 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:36.650411 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.650690 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.651446 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] PATH_INFO: `/v3/users/461d8ec2e117485487b5a7bbb0bd07f5` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.652620 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461d8ec2e117485487b5a7bbb0bd07f5)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:36.654546 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:36.824577 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461d8ec2e117485487b5a7bbb0bd07f5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:36.825230 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461d8ec2e117485487b5a7bbb0bd07f5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:36.836287 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461d8ec2e117485487b5a7bbb0bd07f5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:36.836914 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461d8ec2e117485487b5a7bbb0bd07f5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:36.844376 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461d8ec2e117485487b5a7bbb0bd07f5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:36.926189 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1417/2858] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:27:36 2022] DELETE /identity/v3/users/461d8ec2e117485487b5a7bbb0bd07f5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:36.937732 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d207b61-ef38-4fd0-8437-a0bcdaab1b44 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:36.938021 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d207b61-ef38-4fd0-8437-a0bcdaab1b44 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:36.938339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d207b61-ef38-4fd0-8437-a0bcdaab1b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:36.955620 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-3d207b61-ef38-4fd0-8437-a0bcdaab1b44 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:36.956891 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3d207b61-ef38-4fd0-8437-a0bcdaab1b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:37.012822 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1442/2859] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:37.022293 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:37.023799 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:37.078524 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf97a7f-d0aa-45f4-94c9-06bf945bc7b1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:37.082266 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c335f-56e1-481a-b21c-cba69b539054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:37.083000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c335f-56e1-481a-b21c-cba69b539054 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:37.083282 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c335f-56e1-481a-b21c-cba69b539054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:37.083582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c335f-56e1-481a-b21c-cba69b539054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:37.093432 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c335f-56e1-481a-b21c-cba69b539054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:37.095034 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c335f-56e1-481a-b21c-cba69b539054 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:37.104247 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1418/2860] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:37.569833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d207b61-ef38-4fd0-8437-a0bcdaab1b44 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:37.571490 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-3d207b61-ef38-4fd0-8437-a0bcdaab1b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:37.584971 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d207b61-ef38-4fd0-8437-a0bcdaab1b44 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:37.590107 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:37.591339 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:37.591569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:37.591839 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] PATH_INFO: `/v3/projects/54992d30c1254e95a12c132a978e89b1` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:37.593065 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54992d30c1254e95a12c132a978e89b1)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:37.595118 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:37.676372 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54992d30c1254e95a12c132a978e89b1', 'request_id': 'req-60f4b949-ef4b-42b6-b2b6-45e45407f852'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:37.722830 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54992d30c1254e95a12c132a978e89b1', 'request_id': 'req-60f4b949-ef4b-42b6-b2b6-45e45407f852'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:37.728171 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54992d30c1254e95a12c132a978e89b1', 'request_id': 'req-60f4b949-ef4b-42b6-b2b6-45e45407f852'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:37.739516 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] The token cache is being invalidate because project 54992d30c1254e95a12c132a978e89b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:37.739795 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:37.740496 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-60f4b949-ef4b-42b6-b2b6-45e45407f852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:37.742075 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1443/2861] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:37 2022] DELETE /identity/v3/projects/54992d30c1254e95a12c132a978e89b1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:37.747507 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53a846-8931-4737-bbee-ccd2feb217b9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:37.747797 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53a846-8931-4737-bbee-ccd2feb217b9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:37.748075 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53a846-8931-4737-bbee-ccd2feb217b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:37.765313 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-aa53a846-8931-4737-bbee-ccd2feb217b9 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:37.766529 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-aa53a846-8931-4737-bbee-ccd2feb217b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:37.823413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1419/2862] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:37.883726 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72e31-190e-4b05-a26d-10f86e19f556 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:37.884032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72e31-190e-4b05-a26d-10f86e19f556 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:37.884283 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72e31-190e-4b05-a26d-10f86e19f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:37.902034 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-e1d72e31-190e-4b05-a26d-10f86e19f556 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:37.903288 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e1d72e31-190e-4b05-a26d-10f86e19f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:37.910987 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1444/2863] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:37.915001 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53a846-8931-4737-bbee-ccd2feb217b9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:37.924918 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53a846-8931-4737-bbee-ccd2feb217b9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:37.929509 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb811-2f73-48eb-aa9e-9adc8b7dfe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:37.930122 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb811-2f73-48eb-aa9e-9adc8b7dfe4c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:37.930408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb811-2f73-48eb-aa9e-9adc8b7dfe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:37.930683 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb811-2f73-48eb-aa9e-9adc8b7dfe4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:37.931402 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cb811-2f73-48eb-aa9e-9adc8b7dfe4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 15:27:37.931710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cb811-2f73-48eb-aa9e-9adc8b7dfe4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:37.933950 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cb811-2f73-48eb-aa9e-9adc8b7dfe4c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:37.944980 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1420/2864] 10.222.0.44 () {58 vars in 1152 bytes} [Mon May 16 15:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 15:27:37.948948 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d72e31-190e-4b05-a26d-10f86e19f556 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:37.957766 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d72e31-190e-4b05-a26d-10f86e19f556 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:37.962389 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c2d4-5c57-43d1-94eb-cd8a635b4324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:37.963018 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c2d4-5c57-43d1-94eb-cd8a635b4324 admin admin] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:37.963293 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c2d4-5c57-43d1-94eb-cd8a635b4324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:37.963563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c2d4-5c57-43d1-94eb-cd8a635b4324 admin admin] PATH_INFO: `/v3/projects` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:37.964235 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3c2d4-5c57-43d1-94eb-cd8a635b4324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:37.966390 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3c2d4-5c57-43d1-94eb-cd8a635b4324 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:38.053899 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1445/2865] 10.222.0.44 () {60 vars in 1152 bytes} [Mon May 16 15:27:37 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 15:27:38.058040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb811-2f73-48eb-aa9e-9adc8b7dfe4c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:38.067883 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb811-2f73-48eb-aa9e-9adc8b7dfe4c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:38.122726 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d2c3-7c44-480a-ad4f-1ca807b4e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:38.123390 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d2c3-7c44-480a-ad4f-1ca807b4e7cb admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:38.123672 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d2c3-7c44-480a-ad4f-1ca807b4e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:38.123946 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d2c3-7c44-480a-ad4f-1ca807b4e7cb admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:38.124622 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d2c3-7c44-480a-ad4f-1ca807b4e7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:38.126575 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d2c3-7c44-480a-ad4f-1ca807b4e7cb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:38.224602 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1421/2866] 10.222.0.44 () {60 vars in 1143 bytes} [Mon May 16 15:27:38 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 15:27:38.228610 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c2d4-5c57-43d1-94eb-cd8a635b4324 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:38.239611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c2d4-5c57-43d1-94eb-cd8a635b4324 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:38.244330 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b745f0-6e03-40b0-b477-d9b6dc6b0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:38.244979 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b745f0-6e03-40b0-b477-d9b6dc6b0283 admin admin] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:38.245261 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b745f0-6e03-40b0-b477-d9b6dc6b0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:38.245563 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b745f0-6e03-40b0-b477-d9b6dc6b0283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:38.246317 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b745f0-6e03-40b0-b477-d9b6dc6b0283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:38.247917 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b745f0-6e03-40b0-b477-d9b6dc6b0283 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:38.259393 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1446/2867] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 15:27:38.263326 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d2c3-7c44-480a-ad4f-1ca807b4e7cb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:38.273413 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d2c3-7c44-480a-ad4f-1ca807b4e7cb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:38.278710 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432b006-0f7a-42cb-9cd7-408a7857e2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:38.279364 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432b006-0f7a-42cb-9cd7-408a7857e2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:38.279647 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432b006-0f7a-42cb-9cd7-408a7857e2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:38.279924 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432b006-0f7a-42cb-9cd7-408a7857e2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:38.280769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432b006-0f7a-42cb-9cd7-408a7857e2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:38.282476 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432b006-0f7a-42cb-9cd7-408a7857e2ae admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:38.293547 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1422/2868] 10.222.0.44 () {58 vars in 1121 bytes} [Mon May 16 15:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 15:27:38.297811 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b745f0-6e03-40b0-b477-d9b6dc6b0283 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:38.307523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b745f0-6e03-40b0-b477-d9b6dc6b0283 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:38.312094 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd641c-0845-41d7-930a-f0a9ed622330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:38.312950 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd641c-0845-41d7-930a-f0a9ed622330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:38.313227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd641c-0845-41d7-930a-f0a9ed622330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:38.313495 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd641c-0845-41d7-930a-f0a9ed622330 admin admin] PATH_INFO: `/v3/projects/c7716b1e176c4cac94e5334cfe66ebbc/users/5bb18333a8ef4214acd01e49434b7719/roles/d692349bc8bd4c8d940a2c7cacd96df8` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:38.327477 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd641c-0845-41d7-930a-f0a9ed622330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7716b1e176c4cac94e5334cfe66ebbc, user_id=5bb18333a8ef4214acd01e49434b7719, role_id=d692349bc8bd4c8d940a2c7cacd96df8)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:38.330131 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd641c-0845-41d7-930a-f0a9ed622330 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:38.414601 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1447/2869] 10.222.0.44 () {60 vars in 1482 bytes} [Mon May 16 15:27:38 2022] PUT /identity/v3/projects/c7716b1e176c4cac94e5334cfe66ebbc/users/5bb18333a8ef4214acd01e49434b7719/roles/d692349bc8bd4c8d940a2c7cacd96df8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:38.424587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c0bd-7816-4b0d-913f-75884165ce0e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:38.424909 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c0bd-7816-4b0d-913f-75884165ce0e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:38.425182 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c0bd-7816-4b0d-913f-75884165ce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:38.453614 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5637c0bd-7816-4b0d-913f-75884165ce0e None None] MFA Rules not processed for user `5bb18333a8ef4214acd01e49434b7719`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:38.455101 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5637c0bd-7816-4b0d-913f-75884165ce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:38.523302 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1423/2870] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:38.534506 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd641c-0845-41d7-930a-f0a9ed622330 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:38.536322 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-30cd641c-0845-41d7-930a-f0a9ed622330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:38.592784 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd641c-0845-41d7-930a-f0a9ed622330 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:38.596485 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61e57c-1580-4472-9a56-b1e808acf227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55591aa3b6324ce99d1529beb8f6de2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:38.597127 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61e57c-1580-4472-9a56-b1e808acf227 service cinder] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:38.597408 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61e57c-1580-4472-9a56-b1e808acf227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:38.597683 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61e57c-1580-4472-9a56-b1e808acf227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:38.606434 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61e57c-1580-4472-9a56-b1e808acf227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:38.607894 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61e57c-1580-4472-9a56-b1e808acf227 service cinder] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:38.616777 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1448/2871] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:49.713055 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637c0bd-7816-4b0d-913f-75884165ce0e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:49.771386 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637c0bd-7816-4b0d-913f-75884165ce0e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:49.775844 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:49.776686 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:49.776960 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:49.777225 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] PATH_INFO: `/v3/users/5bb18333a8ef4214acd01e49434b7719` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:49.778419 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb18333a8ef4214acd01e49434b7719)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:49.780415 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:49.942099 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb18333a8ef4214acd01e49434b7719'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:49.942798 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb18333a8ef4214acd01e49434b7719'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:49.954125 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb18333a8ef4214acd01e49434b7719'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:49.954691 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb18333a8ef4214acd01e49434b7719'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:49.961385 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb18333a8ef4214acd01e49434b7719'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:50.031749 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1424/2872] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:27:49 2022] DELETE /identity/v3/users/5bb18333a8ef4214acd01e49434b7719 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:50.036240 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34e6f4-f532-4b9d-a43b-4633e2512785 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:50.036722 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34e6f4-f532-4b9d-a43b-4633e2512785 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:50.036832 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34e6f4-f532-4b9d-a43b-4633e2512785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:50.053794 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-ea34e6f4-f532-4b9d-a43b-4633e2512785 None None] MFA Rules not processed for user `efb24a53849544a0bc7346ef2b1d8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:50.055012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ea34e6f4-f532-4b9d-a43b-4633e2512785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:50.111486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1449/2873] 10.222.0.44 () {58 vars in 957 bytes} [Mon May 16 15:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:50.121190 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:50.122648 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:50.178527 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a478df-0275-49a1-83b0-07f2d46b4ff8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:50.182288 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f0a51-9ba0-482a-9604-738c7d72fa75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:50.182933 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f0a51-9ba0-482a-9604-738c7d72fa75 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:50.183212 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f0a51-9ba0-482a-9604-738c7d72fa75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:50.183484 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f0a51-9ba0-482a-9604-738c7d72fa75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:50.192666 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f0a51-9ba0-482a-9604-738c7d72fa75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:50.194146 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f0a51-9ba0-482a-9604-738c7d72fa75 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:50.203815 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1425/2874] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:50.650518 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34e6f4-f532-4b9d-a43b-4633e2512785 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:50.651947 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-ea34e6f4-f532-4b9d-a43b-4633e2512785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:50.664569 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34e6f4-f532-4b9d-a43b-4633e2512785 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:50.669449 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:50.670418 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:50.670696 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:50.671012 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] PATH_INFO: `/v3/projects/c7716b1e176c4cac94e5334cfe66ebbc` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:50.672227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7716b1e176c4cac94e5334cfe66ebbc)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:50.674176 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:50.806302 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7716b1e176c4cac94e5334cfe66ebbc', 'request_id': 'req-9bed5aca-c273-444e-8a76-c0adbf3db16c'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:50.865749 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7716b1e176c4cac94e5334cfe66ebbc', 'request_id': 'req-9bed5aca-c273-444e-8a76-c0adbf3db16c'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:50.871423 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7716b1e176c4cac94e5334cfe66ebbc', 'request_id': 'req-9bed5aca-c273-444e-8a76-c0adbf3db16c'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:50.882752 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] The token cache is being invalidate because project c7716b1e176c4cac94e5334cfe66ebbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80179) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:27:50.883032 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:50.883642 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-9bed5aca-c273-444e-8a76-c0adbf3db16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:27:50.885202 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1450/2875] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:27:50 2022] DELETE /identity/v3/projects/c7716b1e176c4cac94e5334cfe66ebbc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:27:52.925104 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7206e9e-2a78-4505-9e89-6745b240fb6b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:52.925643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7206e9e-2a78-4505-9e89-6745b240fb6b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:52.925643 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7206e9e-2a78-4505-9e89-6745b240fb6b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:52.927068 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1426/2876] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:27:52.932921 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be63f-295a-4821-b7c5-2be4e28a09c8 None None] REQUEST_METHOD: `POST` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:52.933375 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be63f-295a-4821-b7c5-2be4e28a09c8 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:52.933538 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be63f-295a-4821-b7c5-2be4e28a09c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:52.979697 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.auth.core [None req-db6be63f-295a-4821-b7c5-2be4e28a09c8 None None] MFA Rules not processed for user `aec8440b7bd84c2b9ce583a01adabf90`. Rule list: `[]` (Enabled: `True`). {{(pid=80179) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:52.980905 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-db6be63f-295a-4821-b7c5-2be4e28a09c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:53.031391 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1451/2877] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:27:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:53.043284 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7206e9e-2a78-4505-9e89-6745b240fb6b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:53.044955 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c7206e9e-2a78-4505-9e89-6745b240fb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:53.058605 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7206e9e-2a78-4505-9e89-6745b240fb6b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:53.062571 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f924f9-7cb0-45b5-bbcf-0261644cd2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:53.063205 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f924f9-7cb0-45b5-bbcf-0261644cd2ce service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:53.063481 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f924f9-7cb0-45b5-bbcf-0261644cd2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:53.063748 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f924f9-7cb0-45b5-bbcf-0261644cd2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:53.070635 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f924f9-7cb0-45b5-bbcf-0261644cd2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:53.072042 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f924f9-7cb0-45b5-bbcf-0261644cd2ce service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:53.079711 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1427/2878] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:27:53.162934 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a897-397d-4e3f-8b6d-ce1d51e74d11 None None] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:53.163219 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a897-397d-4e3f-8b6d-ce1d51e74d11 None None] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:53.163492 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a897-397d-4e3f-8b6d-ce1d51e74d11 None None] PATH_INFO: `/` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:53.164862 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1452/2879] 10.222.0.44 () {54 vars in 921 bytes} [Mon May 16 15:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 15:27:53.169979 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83dbce-7b5d-45b2-9780-32b185dcb4ae None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:53.170292 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83dbce-7b5d-45b2-9780-32b185dcb4ae None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:53.171197 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83dbce-7b5d-45b2-9780-32b185dcb4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:53.188600 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4e83dbce-7b5d-45b2-9780-32b185dcb4ae None None] MFA Rules not processed for user `dc19a5d9ce774f39aa49ab7c64ba682e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 15:27:53.189765 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4e83dbce-7b5d-45b2-9780-32b185dcb4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:27:53.252262 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1428/2880] 10.222.0.44 () {58 vars in 1018 bytes} [Mon May 16 15:27:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 15:27:53.262442 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a897-397d-4e3f-8b6d-ce1d51e74d11 None None] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:27:53.272993 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4a897-397d-4e3f-8b6d-ce1d51e74d11 None None] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:27:53.276473 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d7668-b5af-4a40-ab1e-75b277261632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec8440b7bd84c2b9ce583a01adabf90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:27:53.277099 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d7668-b5af-4a40-ab1e-75b277261632 service neutron] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:27:53.277376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d7668-b5af-4a40-ab1e-75b277261632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:27:53.277643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d7668-b5af-4a40-ab1e-75b277261632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:27:53.287730 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d7668-b5af-4a40-ab1e-75b277261632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:27:53.289140 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d7668-b5af-4a40-ab1e-75b277261632 service neutron] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:27:53.300164 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1453/2881] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:27:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:18.897739 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83dbce-7b5d-45b2-9780-32b185dcb4ae None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:18.899179 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4e83dbce-7b5d-45b2-9780-32b185dcb4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:18.982906 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83dbce-7b5d-45b2-9780-32b185dcb4ae None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:18.987855 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688a44a-0470-48dd-99a8-8227f17bc492 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dfdb39ae2804b2191cea53f2a387c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:18.988489 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688a44a-0470-48dd-99a8-8227f17bc492 service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:18.988792 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688a44a-0470-48dd-99a8-8227f17bc492 service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:18.989066 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688a44a-0470-48dd-99a8-8227f17bc492 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:18.990819 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1688a44a-0470-48dd-99a8-8227f17bc492 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:19.001969 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688a44a-0470-48dd-99a8-8227f17bc492 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:19.003565 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688a44a-0470-48dd-99a8-8227f17bc492 service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:19.013261 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1429/2882] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:29:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 15:29:32.599813 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d7668-b5af-4a40-ab1e-75b277261632 service neutron] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:32.603253 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-e73d7668-b5af-4a40-ab1e-75b277261632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:32.665893 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d7668-b5af-4a40-ab1e-75b277261632 service neutron] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:32.670376 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:32.671227 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:32.671503 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:32.671772 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] PATH_INFO: `/v3/users/4109353d2bd843bf9756404990ea6832` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:32.677347 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4109353d2bd843bf9756404990ea6832)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:32.679273 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:32.846193 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4109353d2bd843bf9756404990ea6832'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:32.846821 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4109353d2bd843bf9756404990ea6832'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:32.847421 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4109353d2bd843bf9756404990ea6832'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:32.858745 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4109353d2bd843bf9756404990ea6832'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:32.865739 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4109353d2bd843bf9756404990ea6832'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:32.933467 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1454/2883] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:29:32 2022] DELETE /identity/v3/users/4109353d2bd843bf9756404990ea6832 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:33.184000 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688a44a-0470-48dd-99a8-8227f17bc492 service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:33.201223 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688a44a-0470-48dd-99a8-8227f17bc492 service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:33.258697 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:33.259582 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:33.259861 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:33.260134 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] PATH_INFO: `/v3/projects/0b6bd797b8e04be18b7484855142b067` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:33.261298 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6bd797b8e04be18b7484855142b067)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:33.263220 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:33.354306 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6bd797b8e04be18b7484855142b067', 'request_id': 'req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.360380 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6bd797b8e04be18b7484855142b067', 'request_id': 'req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.366496 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6bd797b8e04be18b7484855142b067', 'request_id': 'req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.468743 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] The token cache is being invalidate because project 0b6bd797b8e04be18b7484855142b067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:29:33.469084 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.469859 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.471731 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1430/2884] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:29:33 2022] DELETE /identity/v3/projects/0b6bd797b8e04be18b7484855142b067 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:33.475809 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:33.482663 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:33.489913 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99d727-eff4-4ca9-8bd7-3ee5e21ff40e admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:33.542486 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:33.543333 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:33.543611 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:33.543883 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] PATH_INFO: `/v3/users/a4b2da79c5984fd1a25b5014c9e258cf` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:33.545055 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b2da79c5984fd1a25b5014c9e258cf)` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:33.547092 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:33.709201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b2da79c5984fd1a25b5014c9e258cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.709855 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b2da79c5984fd1a25b5014c9e258cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.710450 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b2da79c5984fd1a25b5014c9e258cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.722706 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b2da79c5984fd1a25b5014c9e258cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.729643 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.notifications [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b2da79c5984fd1a25b5014c9e258cf'} {{(pid=80179) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:33.821201 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1455/2885] 10.222.0.44 () {58 vars in 1223 bytes} [Mon May 16 15:29:33 2022] DELETE /identity/v3/users/a4b2da79c5984fd1a25b5014c9e258cf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:29:34.044790 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:29:34.046241 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:29:34.060040 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364bbd0-8cc3-454b-a14f-b30f9fba85d1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:29:34.116540 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efb24a53849544a0bc7346ef2b1d8c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '205b1267d8204d608304e6a78a0e361f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:29:34.117392 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:29:34.117678 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:29:34.117959 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] PATH_INFO: `/v3/projects/ff1e322046a64fcf804af32d3a3983a8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:29:34.122454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1e322046a64fcf804af32d3a3983a8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:29:34.122454 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:29:34.242590 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1e322046a64fcf804af32d3a3983a8', 'request_id': 'req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:34.248408 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1e322046a64fcf804af32d3a3983a8', 'request_id': 'req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:34.253801 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1e322046a64fcf804af32d3a3983a8', 'request_id': 'req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:34.329301 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] The token cache is being invalidate because project ff1e322046a64fcf804af32d3a3983a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 15:29:34.329587 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:34.330234 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-6aa69f92-4881-4be3-a6a7-d30c9f3d194e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 15:29:34.331769 dv-cinder-795785-10-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1431/2886] 10.222.0.44 () {58 vars in 1232 bytes} [Mon May 16 15:29:34 2022] DELETE /identity/v3/projects/ff1e322046a64fcf804af32d3a3983a8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 15:34:23.746416 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] Authenticating user token {{(pid=80179) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 15:34:23.747833 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:34:23.813129 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d368f-b64c-44d7-9272-514da52a7bf7 admin admin] Validating token access rules against request {{(pid=80179) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 15:34:23.868178 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a885e2-5d63-47e9-beeb-f421577113bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dfdb39ae2804b2191cea53f2a387c3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6f844054076425cbd50972e6c4a625f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80179) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 15:34:23.868817 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a885e2-5d63-47e9-beeb-f421577113bf service placement] REQUEST_METHOD: `GET` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 15:34:23.869101 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a885e2-5d63-47e9-beeb-f421577113bf service placement] SCRIPT_NAME: `/identity` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 15:34:23.869374 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a885e2-5d63-47e9-beeb-f421577113bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80179) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 15:34:23.871158 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.fernet_utils [None req-f2a885e2-5d63-47e9-beeb-f421577113bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80179) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 15:34:23.881930 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a885e2-5d63-47e9-beeb-f421577113bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 15:34:23.883523 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a885e2-5d63-47e9-beeb-f421577113bf service placement] RBAC: Authorization granted {{(pid=80179) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 15:34:23.893077 dv-cinder-795785-10-iscsi devstack@keystone.service[80179]: [pid: 80179|app: 0|req: 1456/2887] 10.222.0.44 () {60 vars in 1365 bytes} [Mon May 16 15:34:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)